-- Logs begin at Mon 2022-08-22 11:52:02 UTC, end at Mon 2022-08-22 13:01:45 UTC. -- Aug 22 12:25:30.430596 dv-cinder-850836-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 12:25:30.439677 dv-cinder-850836-6-smb devstack@keystone.service[81783]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 12:25:30 2022] *** Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: nodename: dv-cinder-850836-6-smb Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: machine: x86_64 Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: clock source: unix Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: pcre jit disabled Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: detected number of CPU cores: 4 Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: current working directory: / Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: detected binary path: /usr/bin/uwsgi-core Aug 22 12:25:30.441999 dv-cinder-850836-6-smb devstack@keystone.service[81783]: your processes number limit is 47680 Aug 22 12:25:30.442632 dv-cinder-850836-6-smb devstack@keystone.service[81783]: your memory page size is 4096 bytes Aug 22 12:25:30.442632 dv-cinder-850836-6-smb devstack@keystone.service[81783]: detected max file descriptor number: 2048 Aug 22 12:25:30.442632 dv-cinder-850836-6-smb devstack@keystone.service[81783]: lock engine: pthread robust mutexes Aug 22 12:25:30.442632 dv-cinder-850836-6-smb devstack@keystone.service[81783]: thunder lock: enabled Aug 22 12:25:30.442632 dv-cinder-850836-6-smb devstack@keystone.service[81783]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 12:25:30.442632 dv-cinder-850836-6-smb devstack@keystone.service[81783]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 12:25:30.483021 dv-cinder-850836-6-smb devstack@keystone.service[81783]: Python main interpreter initialized at 0x5556186349c0 Aug 22 12:25:30.483021 dv-cinder-850836-6-smb devstack@keystone.service[81783]: python threads support enabled Aug 22 12:25:30.483021 dv-cinder-850836-6-smb devstack@keystone.service[81783]: your server socket listen backlog is limited to 100 connections Aug 22 12:25:30.483021 dv-cinder-850836-6-smb devstack@keystone.service[81783]: your mercy for graceful operations on workers is 90 seconds Aug 22 12:25:30.483376 dv-cinder-850836-6-smb devstack@keystone.service[81783]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 12:25:30.483493 dv-cinder-850836-6-smb devstack@keystone.service[81783]: *** Operational MODE: preforking *** Aug 22 12:25:30.483769 dv-cinder-850836-6-smb devstack@keystone.service[81783]: *** uWSGI is running in multiple interpreter mode *** Aug 22 12:25:30.483769 dv-cinder-850836-6-smb devstack@keystone.service[81783]: spawned uWSGI master process (pid: 81783) Aug 22 12:25:30.483964 dv-cinder-850836-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 22 12:25:30.487706 dv-cinder-850836-6-smb devstack@keystone.service[81783]: spawned uWSGI worker 1 (pid: 81819, cores: 1) Aug 22 12:25:30.487706 dv-cinder-850836-6-smb devstack@keystone.service[81783]: spawned uWSGI worker 2 (pid: 81822, cores: 1) Aug 22 12:25:30.487706 dv-cinder-850836-6-smb devstack@keystone.service[81783]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 12:25:34.802513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:25:34.802513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: from cryptography.utils import int_from_bytes Aug 22 12:25:34.803331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:25:34.803331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: from cryptography.utils import int_from_bytes Aug 22 12:25:34.806444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:25:34.806444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: from cryptography.utils import int_from_bytes Aug 22 12:25:34.806924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:25:34.806924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: from cryptography.utils import int_from_bytes Aug 22 12:25:34.856797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 12:25:34.856991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 12:25:34.857185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] command line args: [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 12:25:34.857510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 12:25:34.857638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ================================================================================ {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 12:25:34.857896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] admin_token = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.858143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] config_dir = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.863460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.863563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 12:25:34.863648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] config_source = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.863722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 12:25:34.863799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] debug = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.863877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] command line args: [] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 12:25:34.863959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 12:25:34.864274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ================================================================================ {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 12:25:34.864391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] admin_token = **** {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] config_dir = [] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] config_source = [] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] debug = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.864999 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_config_append = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_dir = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_file = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865378 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] list_limit = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] log_config_append = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.865948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.866018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.866081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.866139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] log_dir = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.866139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] log_file = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.866289 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.866356 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.866436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.867148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.867600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.867689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.867755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.867823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.867890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.867954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] publish_errors = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.868985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] standard_threads = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] publish_errors = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.869812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.870771 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] use_journal = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.870869 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.870944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] use_json = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] use_stderr = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871168 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871244 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] use_syslog = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] standard_threads = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871550 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.871622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.871767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.871907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] use_journal = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.871907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] use_json = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.872110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.872187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] use_stderr = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.872264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.872335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] use_syslog = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.872405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.872484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:34.872557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.872627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.872696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.872766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.872835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.872911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.872983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873196 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873647 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.873947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.874891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875321 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875459 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.875974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876113 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.876962 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877191 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877398 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877552 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.877948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.878028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.878185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.878292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.878443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.878522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.878676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.878787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.878917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.879005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.879157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.879269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.879394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.879499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.879633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.879758 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.879858 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.879961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.880093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.880175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.880328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.880418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.880571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.880661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.880785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.880860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.881028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.881150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.881258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.881345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.881496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.881575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.881736 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.881816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.881975 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.882058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.882285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.883323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.883323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.883463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.883593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.883682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.883763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.883882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.883958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884312 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.884994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.885157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.885252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.885379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.885463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.885649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.885730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.885893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.885972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.886133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.886232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.886404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.886483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.886643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.886731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.886927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.887007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.887122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.887207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.887361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.887445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.887638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.887768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.887845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.887917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.888070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.888187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.888308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.888401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.888545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.888624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.888782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.888861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.889037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.889122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.889274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.889352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.889516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.889593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.889752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.889837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.889992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.890068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.890295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.890381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.890484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.895228 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.895345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.895425 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.895543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.895619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.895690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.895775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.895849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.895920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.895991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896377 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896597 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.896977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.external = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.897853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.898043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.password = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.898539 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.898622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.token = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.898694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.898793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.898878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.898960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] auth.external = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] auth.password = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] auth.token = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.899986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900178 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.900958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] credential.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901479 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.901991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902377 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902740 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.902973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903190 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] federation.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.903960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904638 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.904937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905159 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905159 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905395 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.905961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.906114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.906211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.906371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.906465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.906644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.906737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.906871 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.906952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.907119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.907208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.907374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.907454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.907621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.907702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.907894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.907982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.908130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.908214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.908367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.908445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.908600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.908688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.908840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.908920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.909073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.909159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.909311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.909399 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.909552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.909631 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.909793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.909873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.910042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.910123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.910298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.910380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.910548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.910636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.910794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.910876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.911029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.911107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.911275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.911357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.911523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.911604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.911753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.911833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.911992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.912072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.912223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.912304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.912462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.912548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.912699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.912779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.912944 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.913024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.913186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.913264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.913502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.913833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914312 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.914984 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.915055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.915159 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.915331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.915416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.915612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.915692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.915842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.915929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.916084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.916165 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.916345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.916461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.916583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.916702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.916838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.916955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.917096 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.917208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.917341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.917460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.917584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.917702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.917828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.917937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.918068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.918176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.918350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.918430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.918615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.918695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.918854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.918946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.919107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.919187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.919357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.919436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.919606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.919694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.919846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.919924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.920082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.920161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.920312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.920397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.920551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.920630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.920786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.920909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.921025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.921153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.921288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.921553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.921648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.921722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.921795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.921943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.922024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.922232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.922318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.922474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.922554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.922706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.922786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.922952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.923032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.923195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.923273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.923433 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.923514 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.923673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.923753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.923916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.923994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.924142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.924217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.924377 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.924457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.924616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.924704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.924858 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.924938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.925109 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.925188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.925359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.925445 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.925597 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.925676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.925838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.925917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.926083 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.926171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.926350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.926475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.926601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.926726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.926840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.926967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.927078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.927211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.927314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] role.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.927458 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] resource.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.927562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] role.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.927716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.927797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.927970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.928049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.928213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.928293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.928469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.928551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.928725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.928804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.928990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.929674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930739 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] role.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] role.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.930953 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.931025 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.931164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.931275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.931421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.931540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.931803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.931885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.932041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.932122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.932293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.932373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.932545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.932629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.932794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.932876 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.933042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.933122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.933282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.933370 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.933537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.933615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.933834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.933928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.934027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.934117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.934284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.934367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.934520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.934714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.934798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.939249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.939381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.939459 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.939533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.939605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.939677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.939762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.939837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.939837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.939968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.940040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.940112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.940192 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.940530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.940611 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.940684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.940756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.940828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.940907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.940982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941053 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941132 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941206 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941720 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941876 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.941948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] token.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.942923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943135 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943206 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.connection = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943611 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.943952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944340 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.944978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.945390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.945458 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.connection = **** {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.945526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.945677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.945801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.945884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.945946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946135 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 12:25:34.946464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.946846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.947051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.947292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.947542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.947779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.948026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.948267 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:34.948442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 12:25:34.974671 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:34.974897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:34.975122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:34.978233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:34.978472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:34.978706 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:34.984238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:34.987451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.012154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.012385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.013612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.013853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.078950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.079583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.131204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.131351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.131425 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.131504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.302969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.303207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.303320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.303447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.303533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.303649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.303745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.303824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.303900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.304138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.304235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.304410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.332887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.333063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.333201 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.333341 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.333490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.333636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.333769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.333899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.334030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.334158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.334322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.334450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.334577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.334577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.345665 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.345800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.359448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.359682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.359908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.360129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.360344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.360498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.360585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.360764 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.360863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.361174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.361474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.361761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.362042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.362357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.378148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.378393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 12:25:35.378737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.378822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.378942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 12:25:35.379096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 12:25:35.379220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.379483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.379605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.379874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 12:25:35.379989 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.380253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.380342 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.380628 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.381203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.381566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.389736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.390017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.390313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.390602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.392142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.392517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.392853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.393204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.397564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.400479 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.400798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.400980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.404511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.404511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.404511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.404511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.404511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.404511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.404889 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.404889 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.404889 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.405088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.405088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.405088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.405088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.405344 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.405418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.405654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.405931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.406343 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.406626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.406900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.426329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.427796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.428081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.431328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.432796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.432880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.433085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.433188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.433371 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.437788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.438082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.438388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.439692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.439982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.444338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.445151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.445529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.445814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.446028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.446112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.446345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.446432 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.446640 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.446908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.450569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.450864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.451151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.451436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.451787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.452073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.452347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.452618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.464025 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.464307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.468140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.470373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.470672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.471384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.471684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.478285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.478424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.478546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.478635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.479280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.482503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.482847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.482931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.483140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.483428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.483708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.483998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.486046 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.489336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.489635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.489927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.490245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.490532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.490822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.500525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.500816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.501086 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.501350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.508388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.508557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.508678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.508950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.509219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.509919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.510217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.512850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.513144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.513431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.513730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.514018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.516203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.517736 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.518017 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.520670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.520961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.521257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.521559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.521842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.526272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.526563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.526847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.527127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.527410 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.527699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.527978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.534181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.534491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.534775 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.535084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.535367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.535646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.535933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.543389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.546419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.549270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.550739 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.552115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.552215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.552483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.552767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.556104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.559101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.559727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.560544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.561179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.562013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.562329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.562628 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.564054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.564357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.564661 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.564946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.569301 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.571764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.573667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.573962 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.574270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.574799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.575105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.575397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.575688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.581088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.587098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.587923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.587998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.588072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.588146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.591615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.591907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.592211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.592482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.592767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.593058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.593339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.593612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.593900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.594178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.594502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.594771 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.595058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.595325 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.619214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5556186349c0 pid: 81822 (default app) Aug 22 12:25:35.622627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6094-efc4-4776-ae99-514bd80399f5 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:35.622914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6094-efc4-4776-ae99-514bd80399f5 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:35.623187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6094-efc4-4776-ae99-514bd80399f5 None None] PATH_INFO: `/v3` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:35.627351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Aug 22 12:25:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:35.630369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5556186349c0 pid: 81819 (default app) Aug 22 12:25:43.265912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47972fe-2281-4ab0-9d72-03eafacc1ccd None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:43.266464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47972fe-2281-4ab0-9d72-03eafacc1ccd None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:43.266557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47972fe-2281-4ab0-9d72-03eafacc1ccd None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:43.267802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:25:43.277295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a625b99-c243-429f-89c9-515e411d122e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:43.277693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a625b99-c243-429f-89c9-515e411d122e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:43.277847 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a625b99-c243-429f-89c9-515e411d122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:43.348020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: INFO dbcounter [None req-8a625b99-c243-429f-89c9-515e411d122e None None] Registered counter for database keystone Aug 22 12:25:43.369330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG oslo_db.sqlalchemy.engines [None req-8a625b99-c243-429f-89c9-515e411d122e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:25:43.375511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writer thread running {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:25:43.553176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG passlib.handlers.bcrypt [None req-8a625b99-c243-429f-89c9-515e411d122e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81819) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 12:25:43.553603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG passlib.handlers.bcrypt [None req-8a625b99-c243-429f-89c9-515e411d122e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81819) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 12:25:43.608259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8a625b99-c243-429f-89c9-515e411d122e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:43.609860 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8a625b99-c243-429f-89c9-515e411d122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:43.739808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 22 12:25:44.189041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47972fe-2281-4ab0-9d72-03eafacc1ccd None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:44.258834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: INFO dbcounter [None req-f47972fe-2281-4ab0-9d72-03eafacc1ccd None None] Registered counter for database keystone Aug 22 12:25:44.278061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG oslo_db.sqlalchemy.engines [None req-f47972fe-2281-4ab0-9d72-03eafacc1ccd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:25:44.284256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writer thread running {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:25:44.405060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47972fe-2281-4ab0-9d72-03eafacc1ccd None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:44.409400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1404c-d516-4be6-92c8-07a9cda37a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:44.410023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1404c-d516-4be6-92c8-07a9cda37a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:44.410338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1404c-d516-4be6-92c8-07a9cda37a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:44.410618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1404c-d516-4be6-92c8-07a9cda37a53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:44.419388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1404c-d516-4be6-92c8-07a9cda37a53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:44.471440 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6ed1404c-d516-4be6-92c8-07a9cda37a53 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 12:25:44.471762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1404c-d516-4be6-92c8-07a9cda37a53 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:44.481415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Aug 22 12:25:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:25:44.487470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a625b99-c243-429f-89c9-515e411d122e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:44.502486 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a625b99-c243-429f-89c9-515e411d122e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:44.507675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55e1b-1a67-4da6-8252-405791e9ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:44.508791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55e1b-1a67-4da6-8252-405791e9ac63 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:44.509081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55e1b-1a67-4da6-8252-405791e9ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:44.509363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55e1b-1a67-4da6-8252-405791e9ac63 admin admin] PATH_INFO: `/v3/projects/6699bdfe1f6a452e99cfdff2e04fc5e9` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:44.510862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55e1b-1a67-4da6-8252-405791e9ac63 admin admin] RBAC: Authorizing `identity:get_project(project_id=6699bdfe1f6a452e99cfdff2e04fc5e9)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:44.563282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: WARNING keystone.common.rbac_enforcer.enforcer [None req-85d55e1b-1a67-4da6-8252-405791e9ac63 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 12:25:44.563638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55e1b-1a67-4da6-8252-405791e9ac63 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:44.568492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 2/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Aug 22 12:25:44 2022] GET /identity/v3/projects/6699bdfe1f6a452e99cfdff2e04fc5e9 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:46.477878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29042a-0c81-49a5-b6f8-29b8050bb9b0 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:46.478389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29042a-0c81-49a5-b6f8-29b8050bb9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:46.478389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29042a-0c81-49a5-b6f8-29b8050bb9b0 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:46.482531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 4/6] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:46.487959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cc88-32f3-4d05-86c9-7fd6e8d37557 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:46.488320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cc88-32f3-4d05-86c9-7fd6e8d37557 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:46.488532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cc88-32f3-4d05-86c9-7fd6e8d37557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:46.508692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-bf95cc88-32f3-4d05-86c9-7fd6e8d37557 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:46.510267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bf95cc88-32f3-4d05-86c9-7fd6e8d37557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:46.518030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 12:25:46.788726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29042a-0c81-49a5-b6f8-29b8050bb9b0 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:46.800591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29042a-0c81-49a5-b6f8-29b8050bb9b0 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:46.805265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e5e9c-57ad-4773-93a4-90a95c0858ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:46.805857 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5e9c-57ad-4773-93a4-90a95c0858ef admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:46.806138 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5e9c-57ad-4773-93a4-90a95c0858ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:46.806439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5e9c-57ad-4773-93a4-90a95c0858ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:46.813954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e5e9c-57ad-4773-93a4-90a95c0858ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:46.816026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e5e9c-57ad-4773-93a4-90a95c0858ef admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:46.825304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Aug 22 12:25:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:25:46.830677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95cc88-32f3-4d05-86c9-7fd6e8d37557 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:46.839941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95cc88-32f3-4d05-86c9-7fd6e8d37557 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:46.844261 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954692e7-953f-4fcc-a374-26cdb75bb962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:46.844893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954692e7-953f-4fcc-a374-26cdb75bb962 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:46.845182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954692e7-953f-4fcc-a374-26cdb75bb962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:46.845464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954692e7-953f-4fcc-a374-26cdb75bb962 admin admin] PATH_INFO: `/v3/users/0beed70e660843e4af019f77be01b3fa` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:46.846803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954692e7-953f-4fcc-a374-26cdb75bb962 admin admin] RBAC: Authorizing `identity:get_user(user_id=0beed70e660843e4af019f77be01b3fa)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:46.848634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954692e7-953f-4fcc-a374-26cdb75bb962 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:46.850161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 4/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Aug 22 12:25:46 2022] GET /identity/v3/users/0beed70e660843e4af019f77be01b3fa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:48.873363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764306b-b96a-4c60-94ca-35f28913ae7a None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:48.873881 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764306b-b96a-4c60-94ca-35f28913ae7a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:48.874004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764306b-b96a-4c60-94ca-35f28913ae7a None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:48.875272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:48.880547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119367c3-c432-480e-9f11-33a0bad7091c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:48.880941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119367c3-c432-480e-9f11-33a0bad7091c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:48.881221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119367c3-c432-480e-9f11-33a0bad7091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:48.899385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-119367c3-c432-480e-9f11-33a0bad7091c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:48.900583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-119367c3-c432-480e-9f11-33a0bad7091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:48.946566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868b5e-3156-4b5b-8d48-ae07c738130a None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:48.946848 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868b5e-3156-4b5b-8d48-ae07c738130a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:48.947127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868b5e-3156-4b5b-8d48-ae07c738130a None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:48.948433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 7/11] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:48.953339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbebca5-a014-4f55-b73d-7aac1c293524 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:48.953627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbebca5-a014-4f55-b73d-7aac1c293524 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:48.953897 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbebca5-a014-4f55-b73d-7aac1c293524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:48.982527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 5/12] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:48.996157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG passlib.handlers.bcrypt [None req-1bbebca5-a014-4f55-b73d-7aac1c293524 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81822) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 12:25:48.996595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG passlib.handlers.bcrypt [None req-1bbebca5-a014-4f55-b73d-7aac1c293524 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81822) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 12:25:49.043155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1bbebca5-a014-4f55-b73d-7aac1c293524 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:49.044733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1bbebca5-a014-4f55-b73d-7aac1c293524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:49.141237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:25:49.250346 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119367c3-c432-480e-9f11-33a0bad7091c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.274316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.354387 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119367c3-c432-480e-9f11-33a0bad7091c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.386745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842f17f-cdb6-4307-8889-c93f9e12af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.387376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f17f-cdb6-4307-8889-c93f9e12af62 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.387663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f17f-cdb6-4307-8889-c93f9e12af62 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.387942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f17f-cdb6-4307-8889-c93f9e12af62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.399831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842f17f-cdb6-4307-8889-c93f9e12af62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:25:49.405541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbebca5-a014-4f55-b73d-7aac1c293524 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-2842f17f-cdb6-4307-8889-c93f9e12af62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:25:49.408616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:25:49.409733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:25:49.410622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 6/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:25:49.415613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842f17f-cdb6-4307-8889-c93f9e12af62 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.497651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.510532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbebca5-a014-4f55-b73d-7aac1c293524 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.512831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.516055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842f17f-cdb6-4307-8889-c93f9e12af62 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.547456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be6cf8-be20-42cf-b4c8-dc854f599db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.548310 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be6cf8-be20-42cf-b4c8-dc854f599db8 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.548593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be6cf8-be20-42cf-b4c8-dc854f599db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.548868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be6cf8-be20-42cf-b4c8-dc854f599db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.550105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d9b1b-0c3c-44c0-b52e-31d0c1423d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.550753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d9b1b-0c3c-44c0-b52e-31d0c1423d72 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.551042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d9b1b-0c3c-44c0-b52e-31d0c1423d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.551327 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d9b1b-0c3c-44c0-b52e-31d0c1423d72 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.551996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d9b1b-0c3c-44c0-b52e-31d0c1423d72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:49.552309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d9b1b-0c3c-44c0-b52e-31d0c1423d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.553765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d9b1b-0c3c-44c0-b52e-31d0c1423d72 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.565728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 7/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:49.571868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d9b1b-0c3c-44c0-b52e-31d0c1423d72 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.616513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be6cf8-be20-42cf-b4c8-dc854f599db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.618043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be6cf8-be20-42cf-b4c8-dc854f599db8 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.669583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d9b1b-0c3c-44c0-b52e-31d0c1423d72 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.703186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbd152-54aa-4562-9eea-c2081e2eee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.703811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbd152-54aa-4562-9eea-c2081e2eee01 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.704097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbd152-54aa-4562-9eea-c2081e2eee01 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.704375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbd152-54aa-4562-9eea-c2081e2eee01 None admin] PATH_INFO: `/v3/users/0beed70e660843e4af019f77be01b3fa` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.705511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbd152-54aa-4562-9eea-c2081e2eee01 None admin] RBAC: Authorizing `identity:get_user(user_id=0beed70e660843e4af019f77be01b3fa)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.707012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbd152-54aa-4562-9eea-c2081e2eee01 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.708564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/users/0beed70e660843e4af019f77be01b3fa => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:49.714656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbd152-54aa-4562-9eea-c2081e2eee01 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.718270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:25:49.723529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be6cf8-be20-42cf-b4c8-dc854f599db8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.727447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.729886 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.813675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbd152-54aa-4562-9eea-c2081e2eee01 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.822303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be6cf8-be20-42cf-b4c8-dc854f599db8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.847393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233242df-4d2f-4bde-91dc-7c3615e9a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.848025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233242df-4d2f-4bde-91dc-7c3615e9a75c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.848324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233242df-4d2f-4bde-91dc-7c3615e9a75c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.848582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233242df-4d2f-4bde-91dc-7c3615e9a75c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.849688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233242df-4d2f-4bde-91dc-7c3615e9a75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.851301 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233242df-4d2f-4bde-91dc-7c3615e9a75c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.852835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:49.858366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ab1ce-adbf-4320-9ab8-b096e1e6563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.858722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233242df-4d2f-4bde-91dc-7c3615e9a75c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.859228 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ab1ce-adbf-4320-9ab8-b096e1e6563c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.859515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ab1ce-adbf-4320-9ab8-b096e1e6563c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.859816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ab1ce-adbf-4320-9ab8-b096e1e6563c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.879274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ab1ce-adbf-4320-9ab8-b096e1e6563c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.880790 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ab1ce-adbf-4320-9ab8-b096e1e6563c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-3e5ab1ce-adbf-4320-9ab8-b096e1e6563c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:25:49.901561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:25:49.902673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:25:49.907280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:25:49.907280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:25:49.907280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:25:49.907280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:25:49.908426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ab1ce-adbf-4320-9ab8-b096e1e6563c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.948111 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.965548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.967388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233242df-4d2f-4bde-91dc-7c3615e9a75c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:50.004910 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38b202-59ea-4cd2-9314-ea35c835269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:50.005518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b202-59ea-4cd2-9314-ea35c835269e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:50.005798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b202-59ea-4cd2-9314-ea35c835269e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:50.006071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b202-59ea-4cd2-9314-ea35c835269e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:50.006867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38b202-59ea-4cd2-9314-ea35c835269e None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.domain.id=default, user.id=0beed70e660843e4af019f77be01b3fa) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:50.007483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38b202-59ea-4cd2-9314-ea35c835269e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:50.008332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ab1ce-adbf-4320-9ab8-b096e1e6563c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:50.008942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38b202-59ea-4cd2-9314-ea35c835269e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:50.015386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/role_assignments?user.id=0beed70e660843e4af019f77be01b3fa&scope.domain.id=default&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:50.044340 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc23b3-aa44-495e-aea9-9f8c68cd178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:50.044974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc23b3-aa44-495e-aea9-9f8c68cd178e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:50.045256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc23b3-aa44-495e-aea9-9f8c68cd178e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:50.045529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc23b3-aa44-495e-aea9-9f8c68cd178e None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:50.046222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc23b3-aa44-495e-aea9-9f8c68cd178e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:50.046520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc23b3-aa44-495e-aea9-9f8c68cd178e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:50.047968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc23b3-aa44-495e-aea9-9f8c68cd178e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:50.069468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:52.230098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a573b9-67c9-47e5-a135-0e6ac4c09dd1 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.231125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a573b9-67c9-47e5-a135-0e6ac4c09dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.231632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a573b9-67c9-47e5-a135-0e6ac4c09dd1 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.233470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:52.238467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1af7b2-a943-4975-804c-8ef721be3a9d None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.238882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1af7b2-a943-4975-804c-8ef721be3a9d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.239053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1af7b2-a943-4975-804c-8ef721be3a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.266311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6c1af7b2-a943-4975-804c-8ef721be3a9d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:52.267502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6c1af7b2-a943-4975-804c-8ef721be3a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:52.300389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffba9e-832f-4ea0-aee0-997a7ec4af22 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.301021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffba9e-832f-4ea0-aee0-997a7ec4af22 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.301492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffba9e-832f-4ea0-aee0-997a7ec4af22 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.303080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 12/23] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:25:52.312981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7c266-651d-40d9-83a1-f7bb78c379e2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.313536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7c266-651d-40d9-83a1-f7bb78c379e2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.314060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7c266-651d-40d9-83a1-f7bb78c379e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.347230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-42c7c266-651d-40d9-83a1-f7bb78c379e2 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:52.348812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-42c7c266-651d-40d9-83a1-f7bb78c379e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:52.403517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:52.470563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:52.757758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acca10-215f-4234-a146-78019056a5fc None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.758447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acca10-215f-4234-a146-78019056a5fc None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.758959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acca10-215f-4234-a146-78019056a5fc None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.760512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 13/26] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:52.766035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90155de0-dcfb-48a3-b904-9adbd99466d2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.766582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90155de0-dcfb-48a3-b904-9adbd99466d2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.767076 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90155de0-dcfb-48a3-b904-9adbd99466d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.791204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-90155de0-dcfb-48a3-b904-9adbd99466d2 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:52.792738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-90155de0-dcfb-48a3-b904-9adbd99466d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:52.824055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acca10-215f-4234-a146-78019056a5fc None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:52.920804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:52.950582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:52.976412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90155de0-dcfb-48a3-b904-9adbd99466d2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:52.986515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.022756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acca10-215f-4234-a146-78019056a5fc None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.081332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e62be3-f0f7-4fe5-b69e-7db84e582126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.082256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e62be3-f0f7-4fe5-b69e-7db84e582126 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.082699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e62be3-f0f7-4fe5-b69e-7db84e582126 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.083121 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e62be3-f0f7-4fe5-b69e-7db84e582126 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.103616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e62be3-f0f7-4fe5-b69e-7db84e582126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-47e62be3-f0f7-4fe5-b69e-7db84e582126 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:25:53.118695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:25:53.119760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:53.120641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:25:53.121278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90155de0-dcfb-48a3-b904-9adbd99466d2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.126216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 14/28] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:25:53.130662 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd54d7b-5c22-4a17-98be-53c28d431cd0 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.130961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd54d7b-5c22-4a17-98be-53c28d431cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.131253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd54d7b-5c22-4a17-98be-53c28d431cd0 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.134613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 15/29] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:53.139082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1d0e-d72c-4b06-8497-6ae1c0fe0d26 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.139209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1d0e-d72c-4b06-8497-6ae1c0fe0d26 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.139454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1d0e-d72c-4b06-8497-6ae1c0fe0d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.164081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571239-8614-46cb-9554-1feb3837ac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.164940 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571239-8614-46cb-9554-1feb3837ac24 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.165390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571239-8614-46cb-9554-1feb3837ac24 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.165814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571239-8614-46cb-9554-1feb3837ac24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.178483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7571239-8614-46cb-9554-1feb3837ac24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.182246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7571239-8614-46cb-9554-1feb3837ac24 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.182373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-548c1d0e-d72c-4b06-8497-6ae1c0fe0d26 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:53.182373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-548c1d0e-d72c-4b06-8497-6ae1c0fe0d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f7571239-8614-46cb-9554-1feb3837ac24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:25:53.211893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:25:53.213028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:25:53.213981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:25:53.213981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:25:53.213981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:25:53.213981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:25:53.213981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571239-8614-46cb-9554-1feb3837ac24 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.302727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.319904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 16/31] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:53.321371 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c1d0e-d72c-4b06-8497-6ae1c0fe0d26 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.357412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571239-8614-46cb-9554-1feb3837ac24 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.395941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89996e-3a81-4a06-b6a2-2087fbf64b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.396857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89996e-3a81-4a06-b6a2-2087fbf64b24 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.397464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89996e-3a81-4a06-b6a2-2087fbf64b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.398065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89996e-3a81-4a06-b6a2-2087fbf64b24 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.398949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89996e-3a81-4a06-b6a2-2087fbf64b24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:53.399488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89996e-3a81-4a06-b6a2-2087fbf64b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.399979 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.406213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89996e-3a81-4a06-b6a2-2087fbf64b24 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.410117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 16/32] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:53.410857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89996e-3a81-4a06-b6a2-2087fbf64b24 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.546962 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c1d0e-d72c-4b06-8497-6ae1c0fe0d26 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.550224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89996e-3a81-4a06-b6a2-2087fbf64b24 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.587664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.618836 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc521023-8e9b-4cd2-9562-5087c610b3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.619452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc521023-8e9b-4cd2-9562-5087c610b3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.619732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc521023-8e9b-4cd2-9562-5087c610b3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.620013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc521023-8e9b-4cd2-9562-5087c610b3e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.620668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc521023-8e9b-4cd2-9562-5087c610b3e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:53.620972 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc521023-8e9b-4cd2-9562-5087c610b3e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.622387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc521023-8e9b-4cd2-9562-5087c610b3e6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.624835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c74d4-4dca-4f2e-8154-a30023dcf407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.625456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c74d4-4dca-4f2e-8154-a30023dcf407 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.625737 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c74d4-4dca-4f2e-8154-a30023dcf407 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.626012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c74d4-4dca-4f2e-8154-a30023dcf407 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.626711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c74d4-4dca-4f2e-8154-a30023dcf407 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.628095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c74d4-4dca-4f2e-8154-a30023dcf407 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.643759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:53.644682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc521023-8e9b-4cd2-9562-5087c610b3e6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.759596 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.766482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc521023-8e9b-4cd2-9562-5087c610b3e6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.808267 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef352-2aa3-4d24-a0cb-97ac448644f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.808897 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef352-2aa3-4d24-a0cb-97ac448644f7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.809176 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef352-2aa3-4d24-a0cb-97ac448644f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.809449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef352-2aa3-4d24-a0cb-97ac448644f7 None admin] PATH_INFO: `/v3/users/0beed70e660843e4af019f77be01b3fa` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.810933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef352-2aa3-4d24-a0cb-97ac448644f7 None admin] RBAC: Authorizing `identity:get_user(user_id=0beed70e660843e4af019f77be01b3fa)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.812381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef352-2aa3-4d24-a0cb-97ac448644f7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.814288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 18/34] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:25:53 2022] GET /identity/v3/users/0beed70e660843e4af019f77be01b3fa => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:53.818234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef352-2aa3-4d24-a0cb-97ac448644f7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.828571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 17/35] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 22 12:25:53 2022] POST /identity/v3/roles => generated 225 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:25:53.829613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c74d4-4dca-4f2e-8154-a30023dcf407 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.950707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c74d4-4dca-4f2e-8154-a30023dcf407 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.960808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef352-2aa3-4d24-a0cb-97ac448644f7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.992083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100361ce-97c8-4c0a-9981-81405bab0469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.992718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100361ce-97c8-4c0a-9981-81405bab0469 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.993008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100361ce-97c8-4c0a-9981-81405bab0469 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.993288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100361ce-97c8-4c0a-9981-81405bab0469 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.993973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100361ce-97c8-4c0a-9981-81405bab0469 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.995640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100361ce-97c8-4c0a-9981-81405bab0469 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.998747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b8f29-48db-4e1d-a11a-d62ceb15095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.999561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b8f29-48db-4e1d-a11a-d62ceb15095c None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.000034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b8f29-48db-4e1d-a11a-d62ceb15095c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.000458 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b8f29-48db-4e1d-a11a-d62ceb15095c None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.001122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b8f29-48db-4e1d-a11a-d62ceb15095c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:54.002521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b8f29-48db-4e1d-a11a-d62ceb15095c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:54.094416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 18/36] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:25:53 2022] POST /identity/v3/projects => generated 301 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:25:54.096240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579b720-6f62-4164-9d27-6170ba9d269b None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.096669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579b720-6f62-4164-9d27-6170ba9d269b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.096962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579b720-6f62-4164-9d27-6170ba9d269b None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.098430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 19/37] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:54.099044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579b720-6f62-4164-9d27-6170ba9d269b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:54.133748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:54.189074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 19/38] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 22 12:25:53 2022] POST /identity/v3/roles => generated 219 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:25:54.189074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4623-2914-46b9-8bda-6c67a413e8cb None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.189074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4623-2914-46b9-8bda-6c67a413e8cb None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.189074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4623-2914-46b9-8bda-6c67a413e8cb None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.189074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 20/39] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:54.189074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082996c-c4d4-4238-9be9-74d2ec797903 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.189074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082996c-c4d4-4238-9be9-74d2ec797903 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.189623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082996c-c4d4-4238-9be9-74d2ec797903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.209286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c082996c-c4d4-4238-9be9-74d2ec797903 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:54.212141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c082996c-c4d4-4238-9be9-74d2ec797903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:54.223154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579b720-6f62-4164-9d27-6170ba9d269b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:54.234152 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:54.266263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3c4d9-6e4e-4920-bd56-37d0f8ccb503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:54.266934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3c4d9-6e4e-4920-bd56-37d0f8ccb503 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.267223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3c4d9-6e4e-4920-bd56-37d0f8ccb503 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.267506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3c4d9-6e4e-4920-bd56-37d0f8ccb503 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.268708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3c4d9-6e4e-4920-bd56-37d0f8ccb503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:54.270475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3c4d9-6e4e-4920-bd56-37d0f8ccb503 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:54.272875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 20/40] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:54.274365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66310cd1-6b61-4bfe-bcf5-86a54194fb3c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.274594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66310cd1-6b61-4bfe-bcf5-86a54194fb3c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.274878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66310cd1-6b61-4bfe-bcf5-86a54194fb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.299410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-66310cd1-6b61-4bfe-bcf5-86a54194fb3c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:54.301259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-66310cd1-6b61-4bfe-bcf5-86a54194fb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:54.302131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 21/41] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:54.303274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082996c-c4d4-4238-9be9-74d2ec797903 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:54.387561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:54.440868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082996c-c4d4-4238-9be9-74d2ec797903 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:54.476451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cb6b-3d37-4703-be07-3e0408d07426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:54.477038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cb6b-3d37-4703-be07-3e0408d07426 None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.477322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cb6b-3d37-4703-be07-3e0408d07426 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.477603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cb6b-3d37-4703-be07-3e0408d07426 None admin] PATH_INFO: `/v3/domains/default/users/0beed70e660843e4af019f77be01b3fa/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.479560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71cb6b-3d37-4703-be07-3e0408d07426 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0beed70e660843e4af019f77be01b3fa, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:54.481145 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71cb6b-3d37-4703-be07-3e0408d07426 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:54.597045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66310cd1-6b61-4bfe-bcf5-86a54194fb3c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:54.603228 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 22/43] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Aug 22 12:25:54 2022] PUT /identity/v3/domains/default/users/0beed70e660843e4af019f77be01b3fa/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:25:54.630301 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:54.670467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cb6b-3d37-4703-be07-3e0408d07426 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:54.689450 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:54.717536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66310cd1-6b61-4bfe-bcf5-86a54194fb3c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:54.761511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848ba9b-ea39-4585-976b-a5241a219c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:54.762136 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ba9b-ea39-4585-976b-a5241a219c0d None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.762412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ba9b-ea39-4585-976b-a5241a219c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.762692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ba9b-ea39-4585-976b-a5241a219c0d None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.763367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848ba9b-ea39-4585-976b-a5241a219c0d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:54.764777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848ba9b-ea39-4585-976b-a5241a219c0d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:54.788831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cb6b-3d37-4703-be07-3e0408d07426 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:54.824049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b3653-bbd2-4eb5-920d-8a651b178d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:54.824934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3653-bbd2-4eb5-920d-8a651b178d1f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.825403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3653-bbd2-4eb5-920d-8a651b178d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.825682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3653-bbd2-4eb5-920d-8a651b178d1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.826793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b3653-bbd2-4eb5-920d-8a651b178d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:54.828302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b3653-bbd2-4eb5-920d-8a651b178d1f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:54.830068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 23/44] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:54.838235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 22 12:25:54 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:25:54.839949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b3653-bbd2-4eb5-920d-8a651b178d1f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:54.930452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:54.950961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b3653-bbd2-4eb5-920d-8a651b178d1f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:54.988430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553a5a4-3eab-4cce-a66b-a08eb2e77480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:54.989052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553a5a4-3eab-4cce-a66b-a08eb2e77480 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.989337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553a5a4-3eab-4cce-a66b-a08eb2e77480 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.989615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553a5a4-3eab-4cce-a66b-a08eb2e77480 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.990321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553a5a4-3eab-4cce-a66b-a08eb2e77480 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:54.992387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553a5a4-3eab-4cce-a66b-a08eb2e77480 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:55.091238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:25:54 2022] POST /identity/v3/projects => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:25:56.514556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d1126-e453-440f-8b21-0b6131c7c61a None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:56.515078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d1126-e453-440f-8b21-0b6131c7c61a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:56.515078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d1126-e453-440f-8b21-0b6131c7c61a None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:56.516392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 23/47] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:56.521835 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d380dc7-735e-4e95-80d9-1ab27555a417 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:56.522871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d380dc7-735e-4e95-80d9-1ab27555a417 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:56.522977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d380dc7-735e-4e95-80d9-1ab27555a417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:56.541536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1d380dc7-735e-4e95-80d9-1ab27555a417 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:56.542743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1d380dc7-735e-4e95-80d9-1ab27555a417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:56.608916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:56.877569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d1126-e453-440f-8b21-0b6131c7c61a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:56.996250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb32dd9-462e-4305-a1e2-b1f1235f01f0 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:56.996621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb32dd9-462e-4305-a1e2-b1f1235f01f0 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:56.996911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb32dd9-462e-4305-a1e2-b1f1235f01f0 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:56.998314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 26/49] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:25:57.003364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded1c7-6fc7-4f80-9344-4a56b146a111 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.003658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded1c7-6fc7-4f80-9344-4a56b146a111 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.003942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded1c7-6fc7-4f80-9344-4a56b146a111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.021906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-b9ded1c7-6fc7-4f80-9344-4a56b146a111 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:57.023768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b9ded1c7-6fc7-4f80-9344-4a56b146a111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:57.075659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:57.082516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:57.089002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d1126-e453-440f-8b21-0b6131c7c61a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:57.091787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 27/50] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:25:57.122447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf212ab-b0a0-47be-8c97-21ede277d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:57.123085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf212ab-b0a0-47be-8c97-21ede277d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.123371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf212ab-b0a0-47be-8c97-21ede277d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.123649 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf212ab-b0a0-47be-8c97-21ede277d3d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.133995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf212ab-b0a0-47be-8c97-21ede277d3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-8bf212ab-b0a0-47be-8c97-21ede277d3d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:25:57.138709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:25:57.139570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:25:57.140323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 24/51] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:25:57.145587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ded1c7-6fc7-4f80-9344-4a56b146a111 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:57.248305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ded1c7-6fc7-4f80-9344-4a56b146a111 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:57.281386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481f443-bb77-4373-8fac-db15fa1f016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:57.281992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481f443-bb77-4373-8fac-db15fa1f016a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.282304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481f443-bb77-4373-8fac-db15fa1f016a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.282581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481f443-bb77-4373-8fac-db15fa1f016a None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.283245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481f443-bb77-4373-8fac-db15fa1f016a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:57.283550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481f443-bb77-4373-8fac-db15fa1f016a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:57.285030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481f443-bb77-4373-8fac-db15fa1f016a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:57.297205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 28/52] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:57.302904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf212ab-b0a0-47be-8c97-21ede277d3d1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:57.361036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481f443-bb77-4373-8fac-db15fa1f016a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:57.404337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf212ab-b0a0-47be-8c97-21ede277d3d1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:57.419121 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:57.439612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5b0b4-69c3-4425-939c-1e4cc80a9379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:57.440256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5b0b4-69c3-4425-939c-1e4cc80a9379 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.440810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5b0b4-69c3-4425-939c-1e4cc80a9379 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.441093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5b0b4-69c3-4425-939c-1e4cc80a9379 None admin] PATH_INFO: `/v3/users/0beed70e660843e4af019f77be01b3fa` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.442325 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5b0b4-69c3-4425-939c-1e4cc80a9379 None admin] RBAC: Authorizing `identity:get_user(user_id=0beed70e660843e4af019f77be01b3fa)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:57.443805 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5b0b4-69c3-4425-939c-1e4cc80a9379 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:57.446110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 25/53] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:25:57 2022] GET /identity/v3/users/0beed70e660843e4af019f77be01b3fa => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:57.451690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5b0b4-69c3-4425-939c-1e4cc80a9379 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:57.463647 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481f443-bb77-4373-8fac-db15fa1f016a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:57.470488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:57.570097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5b0b4-69c3-4425-939c-1e4cc80a9379 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:57.605299 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e27399-9ac1-4c63-a929-acf521d085c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:57.605553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed92309-e778-4099-9094-2b0f72baf68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:57.605971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed92309-e778-4099-9094-2b0f72baf68d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.606045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e27399-9ac1-4c63-a929-acf521d085c8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.606230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed92309-e778-4099-9094-2b0f72baf68d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.606343 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e27399-9ac1-4c63-a929-acf521d085c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.606498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e27399-9ac1-4c63-a929-acf521d085c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.606600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed92309-e778-4099-9094-2b0f72baf68d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.607616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e27399-9ac1-4c63-a929-acf521d085c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:57.607716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed92309-e778-4099-9094-2b0f72baf68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:57.609104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed92309-e778-4099-9094-2b0f72baf68d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:57.609206 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e27399-9ac1-4c63-a929-acf521d085c8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:57.610727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 26/55] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:57.610824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 29/55] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:57.616262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e27399-9ac1-4c63-a929-acf521d085c8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:57.616753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed92309-e778-4099-9094-2b0f72baf68d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:57.700736 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:57.716691 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e27399-9ac1-4c63-a929-acf521d085c8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:57.718937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed92309-e778-4099-9094-2b0f72baf68d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:57.741634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:57.750451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2662f-0860-40c9-9a03-67c3578cf045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:57.751070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2662f-0860-40c9-9a03-67c3578cf045 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.751362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2662f-0860-40c9-9a03-67c3578cf045 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.751643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2662f-0860-40c9-9a03-67c3578cf045 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.751802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eab77e-0429-4a8b-b5da-a26fa8cb78ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:57.752303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2662f-0860-40c9-9a03-67c3578cf045 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:57.752403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eab77e-0429-4a8b-b5da-a26fa8cb78ec None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.752674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eab77e-0429-4a8b-b5da-a26fa8cb78ec None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.752951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eab77e-0429-4a8b-b5da-a26fa8cb78ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.753675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eab77e-0429-4a8b-b5da-a26fa8cb78ec None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.domain.id=default, user.id=0beed70e660843e4af019f77be01b3fa) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:57.753761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2662f-0860-40c9-9a03-67c3578cf045 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:57.753985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eab77e-0429-4a8b-b5da-a26fa8cb78ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:57.755449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eab77e-0429-4a8b-b5da-a26fa8cb78ec None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:57.764574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 30/56] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Aug 22 12:25:57 2022] GET /identity/v3/role_assignments?user.id=0beed70e660843e4af019f77be01b3fa&scope.domain.id=default&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:57.840020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 27/57] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Aug 22 12:25:57 2022] POST /identity/v3/projects => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:25:59.759721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7421c81-ca59-4e4a-9a20-d6a6d11e9470 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:59.760247 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7421c81-ca59-4e4a-9a20-d6a6d11e9470 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:59.760397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7421c81-ca59-4e4a-9a20-d6a6d11e9470 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:59.765234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 31/58] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:25:59.767884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559028-865a-407f-8855-c9e3a8577a47 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:59.768372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559028-865a-407f-8855-c9e3a8577a47 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:59.768516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559028-865a-407f-8855-c9e3a8577a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:59.793096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-db559028-865a-407f-8855-c9e3a8577a47 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:59.794370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-db559028-865a-407f-8855-c9e3a8577a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:59.863549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 28/59] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:00.180009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7421c81-ca59-4e4a-9a20-d6a6d11e9470 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:00.280237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7421c81-ca59-4e4a-9a20-d6a6d11e9470 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:00.312458 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d25dc-f22d-445b-b643-cecc90e84e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:00.313077 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d25dc-f22d-445b-b643-cecc90e84e30 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:00.313361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d25dc-f22d-445b-b643-cecc90e84e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:00.313639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d25dc-f22d-445b-b643-cecc90e84e30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:00.314847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d25dc-f22d-445b-b643-cecc90e84e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:00.316546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d25dc-f22d-445b-b643-cecc90e84e30 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:00.318074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 32/60] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:00.324416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db559028-865a-407f-8855-c9e3a8577a47 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:00.389447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:00.424906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db559028-865a-407f-8855-c9e3a8577a47 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:00.457373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb3e0d-248b-48dc-b149-dfc9da83d5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:00.457994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb3e0d-248b-48dc-b149-dfc9da83d5df None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:00.458492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb3e0d-248b-48dc-b149-dfc9da83d5df None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:00.459000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb3e0d-248b-48dc-b149-dfc9da83d5df None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:00.460935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb3e0d-248b-48dc-b149-dfc9da83d5df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:00.462396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb3e0d-248b-48dc-b149-dfc9da83d5df None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:00.575344 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 29/61] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:00 2022] POST /identity/v3/users => generated 275 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:03.664969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38045aed-7e6c-4ea1-b789-5852a6edcd9b None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.665866 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38045aed-7e6c-4ea1-b789-5852a6edcd9b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.666318 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38045aed-7e6c-4ea1-b789-5852a6edcd9b None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.668104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 33/62] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:03.673541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecd937-c264-4515-9dd3-8ab498d1131b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.673947 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecd937-c264-4515-9dd3-8ab498d1131b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.674109 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecd937-c264-4515-9dd3-8ab498d1131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.699303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-feecd937-c264-4515-9dd3-8ab498d1131b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:03.700802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-feecd937-c264-4515-9dd3-8ab498d1131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:03.757637 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da87685-a8f6-42ad-a88e-54ee52463cc8 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.758583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da87685-a8f6-42ad-a88e-54ee52463cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.759067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da87685-a8f6-42ad-a88e-54ee52463cc8 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.760888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 34/63] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:03.766629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179b608-db9e-4f5b-84bc-8f3c2412abbd None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.767469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179b608-db9e-4f5b-84bc-8f3c2412abbd None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.767951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179b608-db9e-4f5b-84bc-8f3c2412abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.798271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1179b608-db9e-4f5b-84bc-8f3c2412abbd None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:03.799519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1179b608-db9e-4f5b-84bc-8f3c2412abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:03.801711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 30/64] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:03.854961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:03.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 35/65] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:03.879779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97136-d538-4329-8235-79246541cd17 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.880083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97136-d538-4329-8235-79246541cd17 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.880435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97136-d538-4329-8235-79246541cd17 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.882600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 31/66] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:03.900074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9de4-9ae0-4b14-b7da-60b76af6f4f8 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.900376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9de4-9ae0-4b14-b7da-60b76af6f4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.900713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9de4-9ae0-4b14-b7da-60b76af6f4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.926654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-259f9de4-9ae0-4b14-b7da-60b76af6f4f8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:03.927772 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-259f9de4-9ae0-4b14-b7da-60b76af6f4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:04.014694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 36/67] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:04.140906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f97136-d538-4329-8235-79246541cd17 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.157454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079b81-95be-4554-adef-7e72364463ce None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.158052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079b81-95be-4554-adef-7e72364463ce None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.158567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079b81-95be-4554-adef-7e72364463ce None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.160137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 37/68] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:04.166476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e582dfb-7366-440b-afc0-cf7dc30f8d9a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.167020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e582dfb-7366-440b-afc0-cf7dc30f8d9a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.167484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e582dfb-7366-440b-afc0-cf7dc30f8d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.207452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.207741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7e582dfb-7366-440b-afc0-cf7dc30f8d9a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:04.210779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7e582dfb-7366-440b-afc0-cf7dc30f8d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:04.271219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f97136-d538-4329-8235-79246541cd17 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.305558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 38/69] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:04.306942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56030081-b853-4126-b72d-0608d86a24a2 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.307399 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56030081-b853-4126-b72d-0608d86a24a2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.307826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56030081-b853-4126-b72d-0608d86a24a2 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.309481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 39/70] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:04.310397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56030081-b853-4126-b72d-0608d86a24a2 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.324304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b62a45-0f6f-42dd-b0d3-6148f10b4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.325313 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b62a45-0f6f-42dd-b0d3-6148f10b4462 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.325676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b62a45-0f6f-42dd-b0d3-6148f10b4462 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.326066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b62a45-0f6f-42dd-b0d3-6148f10b4462 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.341119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b62a45-0f6f-42dd-b0d3-6148f10b4462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-38b62a45-0f6f-42dd-b0d3-6148f10b4462 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:04.352402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:04.353370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:04.354348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:04.355653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 32/71] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:04.356735 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9453c-eb16-4625-a7c6-1ea17956b5ce None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.357032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9453c-eb16-4625-a7c6-1ea17956b5ce None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.357308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9453c-eb16-4625-a7c6-1ea17956b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.368838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.375409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-89b9453c-eb16-4625-a7c6-1ea17956b5ce None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:04.376908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-89b9453c-eb16-4625-a7c6-1ea17956b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:04.426656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56030081-b853-4126-b72d-0608d86a24a2 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.449864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 33/72] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:04.450675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9453c-eb16-4625-a7c6-1ea17956b5ce None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.474808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d67bbe-d27c-4bc1-82cd-da65fc516d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.475867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d67bbe-d27c-4bc1-82cd-da65fc516d28 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.476384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d67bbe-d27c-4bc1-82cd-da65fc516d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.476842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d67bbe-d27c-4bc1-82cd-da65fc516d28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.488855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d67bbe-d27c-4bc1-82cd-da65fc516d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-46d67bbe-d27c-4bc1-82cd-da65fc516d28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:04.494890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:04.499863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 40/73] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:04.500644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d67bbe-d27c-4bc1-82cd-da65fc516d28 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.501933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.580729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9453c-eb16-4625-a7c6-1ea17956b5ce None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.620714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3c3c4-8949-4ffc-ab38-25db04c75cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.621361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3c3c4-8949-4ffc-ab38-25db04c75cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.621650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3c3c4-8949-4ffc-ab38-25db04c75cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.621936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3c3c4-8949-4ffc-ab38-25db04c75cf7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.623987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d67bbe-d27c-4bc1-82cd-da65fc516d28 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.631899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.636533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3c3c4-8949-4ffc-ab38-25db04c75cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-15a3c3c4-8949-4ffc-ab38-25db04c75cf7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:04.641211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:04.647276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 34/74] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:04.648290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3c3c4-8949-4ffc-ab38-25db04c75cf7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.663422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe0793-78eb-440c-9631-2cf3f67fd15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.664707 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0793-78eb-440c-9631-2cf3f67fd15c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.665007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0793-78eb-440c-9631-2cf3f67fd15c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.665559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0793-78eb-440c-9631-2cf3f67fd15c None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.665971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe0793-78eb-440c-9631-2cf3f67fd15c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:04.666555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe0793-78eb-440c-9631-2cf3f67fd15c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:04.668332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe0793-78eb-440c-9631-2cf3f67fd15c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:04.676850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 41/75] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:04.677873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe0793-78eb-440c-9631-2cf3f67fd15c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.758274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3c3c4-8949-4ffc-ab38-25db04c75cf7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.759738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.785590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe0793-78eb-440c-9631-2cf3f67fd15c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.792444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff48723-3fa4-4f36-a24b-c87e80d00e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.793070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff48723-3fa4-4f36-a24b-c87e80d00e55 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.793354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff48723-3fa4-4f36-a24b-c87e80d00e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.793633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff48723-3fa4-4f36-a24b-c87e80d00e55 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.794347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff48723-3fa4-4f36-a24b-c87e80d00e55 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:04.794661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff48723-3fa4-4f36-a24b-c87e80d00e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:04.796077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff48723-3fa4-4f36-a24b-c87e80d00e55 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:04.804623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 35/76] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:04.805415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff48723-3fa4-4f36-a24b-c87e80d00e55 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.822809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320f20e-3912-4dd9-ba6c-43e25ceba979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.823541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320f20e-3912-4dd9-ba6c-43e25ceba979 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.823836 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320f20e-3912-4dd9-ba6c-43e25ceba979 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.824118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320f20e-3912-4dd9-ba6c-43e25ceba979 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.834347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320f20e-3912-4dd9-ba6c-43e25ceba979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-f320f20e-3912-4dd9-ba6c-43e25ceba979 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:04.839615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:04.840510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 42/77] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:04.841574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320f20e-3912-4dd9-ba6c-43e25ceba979 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.869866 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.910495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff48723-3fa4-4f36-a24b-c87e80d00e55 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.940150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320f20e-3912-4dd9-ba6c-43e25ceba979 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.944297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532566b9-c18d-453e-bafe-f792c95815a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.945182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532566b9-c18d-453e-bafe-f792c95815a5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.945469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532566b9-c18d-453e-bafe-f792c95815a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.945748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532566b9-c18d-453e-bafe-f792c95815a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.946442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532566b9-c18d-453e-bafe-f792c95815a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:04.946752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532566b9-c18d-453e-bafe-f792c95815a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:04.948132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532566b9-c18d-453e-bafe-f792c95815a5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:04.955858 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 36/78] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:04.956643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532566b9-c18d-453e-bafe-f792c95815a5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.978523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2499c-7637-49a9-87e4-d2b20b003b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.979164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2499c-7637-49a9-87e4-d2b20b003b2c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.979450 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2499c-7637-49a9-87e4-d2b20b003b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.979727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2499c-7637-49a9-87e4-d2b20b003b2c None admin] PATH_INFO: `/v3/users/0beed70e660843e4af019f77be01b3fa` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.980879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2499c-7637-49a9-87e4-d2b20b003b2c None admin] RBAC: Authorizing `identity:get_user(user_id=0beed70e660843e4af019f77be01b3fa)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:04.982399 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2499c-7637-49a9-87e4-d2b20b003b2c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:04.983201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.984028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 43/79] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/users/0beed70e660843e4af019f77be01b3fa => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:04.984734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2499c-7637-49a9-87e4-d2b20b003b2c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.055946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532566b9-c18d-453e-bafe-f792c95815a5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.079780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.085850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2499c-7637-49a9-87e4-d2b20b003b2c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.092275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f503-5f95-498c-a502-26bae534011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.092275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f503-5f95-498c-a502-26bae534011d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.092275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f503-5f95-498c-a502-26bae534011d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.092275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f503-5f95-498c-a502-26bae534011d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.092567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53f503-5f95-498c-a502-26bae534011d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.093845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53f503-5f95-498c-a502-26bae534011d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.095443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 37/80] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.096291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f503-5f95-498c-a502-26bae534011d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.122155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d78847-6c82-477b-954a-9f2a4aaf2eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.122816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d78847-6c82-477b-954a-9f2a4aaf2eec None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.123097 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d78847-6c82-477b-954a-9f2a4aaf2eec None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.123372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d78847-6c82-477b-954a-9f2a4aaf2eec None admin] PATH_INFO: `/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.137509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d78847-6c82-477b-954a-9f2a4aaf2eec None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c7fa70a7464e9cd9aa6f926b633e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.138993 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d78847-6c82-477b-954a-9f2a4aaf2eec None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.140595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 44/81] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.141347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d78847-6c82-477b-954a-9f2a4aaf2eec None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.193286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.200458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f503-5f95-498c-a502-26bae534011d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.235276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022558a-b627-4b57-9133-e2d88354f0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.235897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022558a-b627-4b57-9133-e2d88354f0ed None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.236185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022558a-b627-4b57-9133-e2d88354f0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.236471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022558a-b627-4b57-9133-e2d88354f0ed None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.237144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022558a-b627-4b57-9133-e2d88354f0ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:05.237452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022558a-b627-4b57-9133-e2d88354f0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.238902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022558a-b627-4b57-9133-e2d88354f0ed None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.244525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d78847-6c82-477b-954a-9f2a4aaf2eec None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.247703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 38/82] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.248501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022558a-b627-4b57-9133-e2d88354f0ed None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.279871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1330f1-2635-43ef-a787-6d146e75d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.280500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1330f1-2635-43ef-a787-6d146e75d692 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.280783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1330f1-2635-43ef-a787-6d146e75d692 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.281061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1330f1-2635-43ef-a787-6d146e75d692 None admin] PATH_INFO: `/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.282222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1330f1-2635-43ef-a787-6d146e75d692 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c7fa70a7464e9cd9aa6f926b633e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.283660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1330f1-2635-43ef-a787-6d146e75d692 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.285403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 45/83] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.285953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1330f1-2635-43ef-a787-6d146e75d692 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.310988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.349475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022558a-b627-4b57-9133-e2d88354f0ed None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.384067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f587727-cab7-43b7-9d02-9132deb2051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.384678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f587727-cab7-43b7-9d02-9132deb2051c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.384985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f587727-cab7-43b7-9d02-9132deb2051c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.385263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f587727-cab7-43b7-9d02-9132deb2051c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.386455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1330f1-2635-43ef-a787-6d146e75d692 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.409630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.420040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a52d1-1618-4366-a9a5-d2de65843e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.421207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a52d1-1618-4366-a9a5-d2de65843e99 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.421207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a52d1-1618-4366-a9a5-d2de65843e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.421207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a52d1-1618-4366-a9a5-d2de65843e99 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.421814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a52d1-1618-4366-a9a5-d2de65843e99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.423289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a52d1-1618-4366-a9a5-d2de65843e99 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.452526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f587727-cab7-43b7-9d02-9132deb2051c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.454003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f587727-cab7-43b7-9d02-9132deb2051c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.548683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 39/84] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:05.549506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f587727-cab7-43b7-9d02-9132deb2051c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.556732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 46/85] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:05 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:05.557761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a52d1-1618-4366-a9a5-d2de65843e99 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.619429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.653301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.671681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f587727-cab7-43b7-9d02-9132deb2051c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.676276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a52d1-1618-4366-a9a5-d2de65843e99 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.711804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae8a3-79ee-4f55-aed0-ceb01b5b504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.712428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae8a3-79ee-4f55-aed0-ceb01b5b504c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.712710 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae8a3-79ee-4f55-aed0-ceb01b5b504c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.713384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae8a3-79ee-4f55-aed0-ceb01b5b504c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.720382 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242d84-57d4-4279-97b6-a3d8d3abc9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.721029 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242d84-57d4-4279-97b6-a3d8d3abc9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.721311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242d84-57d4-4279-97b6-a3d8d3abc9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.721707 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242d84-57d4-4279-97b6-a3d8d3abc9f1 None admin] PATH_INFO: `/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.722918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2242d84-57d4-4279-97b6-a3d8d3abc9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c7fa70a7464e9cd9aa6f926b633e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.724380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2242d84-57d4-4279-97b6-a3d8d3abc9f1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.726095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 47/86] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.726994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242d84-57d4-4279-97b6-a3d8d3abc9f1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.796887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae8a3-79ee-4f55-aed0-ceb01b5b504c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.799390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae8a3-79ee-4f55-aed0-ceb01b5b504c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.851500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242d84-57d4-4279-97b6-a3d8d3abc9f1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.878415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.903668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88e19-90a0-45e7-bdf7-e0e3f8370ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.904396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88e19-90a0-45e7-bdf7-e0e3f8370ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.904749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88e19-90a0-45e7-bdf7-e0e3f8370ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.905095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88e19-90a0-45e7-bdf7-e0e3f8370ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.926461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.931902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 40/87] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:05.933051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae8a3-79ee-4f55-aed0-ceb01b5b504c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.995850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e88e19-90a0-45e7-bdf7-e0e3f8370ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.997591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e88e19-90a0-45e7-bdf7-e0e3f8370ce0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.039423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae8a3-79ee-4f55-aed0-ceb01b5b504c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.076936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f63b18-9ff8-48a6-ab16-1b43aa2de023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.077901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63b18-9ff8-48a6-ab16-1b43aa2de023 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.078408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63b18-9ff8-48a6-ab16-1b43aa2de023 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.078897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63b18-9ff8-48a6-ab16-1b43aa2de023 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.080328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f63b18-9ff8-48a6-ab16-1b43aa2de023 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.082021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f63b18-9ff8-48a6-ab16-1b43aa2de023 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.083890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 41/88] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.084948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f63b18-9ff8-48a6-ab16-1b43aa2de023 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.112545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.134659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 48/89] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:06.135550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88e19-90a0-45e7-bdf7-e0e3f8370ce0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.199068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.206495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f63b18-9ff8-48a6-ab16-1b43aa2de023 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.243427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ed67d-ba1a-4148-af58-020506fee006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.244440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed67d-ba1a-4148-af58-020506fee006 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.244924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed67d-ba1a-4148-af58-020506fee006 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.245408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed67d-ba1a-4148-af58-020506fee006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.270558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88e19-90a0-45e7-bdf7-e0e3f8370ce0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.307049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de45fc3-be0e-48be-a3eb-66c3a5c0affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.308047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45fc3-be0e-48be-a3eb-66c3a5c0affd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.308530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45fc3-be0e-48be-a3eb-66c3a5c0affd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.309025 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45fc3-be0e-48be-a3eb-66c3a5c0affd None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.310400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de45fc3-be0e-48be-a3eb-66c3a5c0affd None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.312225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de45fc3-be0e-48be-a3eb-66c3a5c0affd None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.314474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 49/90] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.315704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de45fc3-be0e-48be-a3eb-66c3a5c0affd None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.338769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ed67d-ba1a-4148-af58-020506fee006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.340803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ed67d-ba1a-4148-af58-020506fee006 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.373055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.435369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de45fc3-be0e-48be-a3eb-66c3a5c0affd None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.453062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.457984 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 42/91] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:06.459227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ed67d-ba1a-4148-af58-020506fee006 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.478104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300a36b-3f5b-414d-b005-10558d64c41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.478748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a36b-3f5b-414d-b005-10558d64c41b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.479031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a36b-3f5b-414d-b005-10558d64c41b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.479311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a36b-3f5b-414d-b005-10558d64c41b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.480507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300a36b-3f5b-414d-b005-10558d64c41b None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea, user.id=0beed70e660843e4af019f77be01b3fa) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:06.480996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300a36b-3f5b-414d-b005-10558d64c41b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.482948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300a36b-3f5b-414d-b005-10558d64c41b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.490140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 50/92] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/role_assignments?user.id=0beed70e660843e4af019f77be01b3fa&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.491608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300a36b-3f5b-414d-b005-10558d64c41b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.576258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ed67d-ba1a-4148-af58-020506fee006 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.606349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.621935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe63cb-6006-47d0-9c98-79e80275b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.624112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe63cb-6006-47d0-9c98-79e80275b5eb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.625370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe63cb-6006-47d0-9c98-79e80275b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.626029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe63cb-6006-47d0-9c98-79e80275b5eb None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.630593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe63cb-6006-47d0-9c98-79e80275b5eb None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.634442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe63cb-6006-47d0-9c98-79e80275b5eb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.636983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 43/93] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.638084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe63cb-6006-47d0-9c98-79e80275b5eb None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.638463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300a36b-3f5b-414d-b005-10558d64c41b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.720101 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93da3f-9b6f-4bfb-9a63-3d75e097ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.720733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93da3f-9b6f-4bfb-9a63-3d75e097ac50 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.720978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93da3f-9b6f-4bfb-9a63-3d75e097ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.721192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93da3f-9b6f-4bfb-9a63-3d75e097ac50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.722110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93da3f-9b6f-4bfb-9a63-3d75e097ac50 None admin] RBAC: Adding query filter params (role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea, user.id=ecc7c7fa70a7464e9cd9aa6f926b633e) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:06.722451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93da3f-9b6f-4bfb-9a63-3d75e097ac50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.723939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93da3f-9b6f-4bfb-9a63-3d75e097ac50 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.748261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 51/94] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/role_assignments?user.id=ecc7c7fa70a7464e9cd9aa6f926b633e&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.749209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93da3f-9b6f-4bfb-9a63-3d75e097ac50 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.802849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe63cb-6006-47d0-9c98-79e80275b5eb None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.840474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.849135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd550-cbaa-40fb-a54d-54c1f729b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.851697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd550-cbaa-40fb-a54d-54c1f729b3aa None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.852652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd550-cbaa-40fb-a54d-54c1f729b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.853785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd550-cbaa-40fb-a54d-54c1f729b3aa None admin] PATH_INFO: `/v3/projects/49987e6ce7ef437582cb75934ccf47d3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.855795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd550-cbaa-40fb-a54d-54c1f729b3aa None admin] RBAC: Authorizing `identity:get_project(project_id=49987e6ce7ef437582cb75934ccf47d3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.865250 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd550-cbaa-40fb-a54d-54c1f729b3aa None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.865250 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 44/95] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/projects/49987e6ce7ef437582cb75934ccf47d3 => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.871003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd550-cbaa-40fb-a54d-54c1f729b3aa None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.939250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93da3f-9b6f-4bfb-9a63-3d75e097ac50 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.994838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00df7-0087-401e-87b2-75e7f3b5a9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.995385 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00df7-0087-401e-87b2-75e7f3b5a9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.995673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00df7-0087-401e-87b2-75e7f3b5a9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.995950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00df7-0087-401e-87b2-75e7f3b5a9d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.996698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00df7-0087-401e-87b2-75e7f3b5a9d1 None admin] RBAC: Adding query filter params (role.id=60c41aabe4694d07bf0b66f5223c3d0d, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea, user.id=ecc7c7fa70a7464e9cd9aa6f926b633e) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:06.997011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00df7-0087-401e-87b2-75e7f3b5a9d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:07.000189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00df7-0087-401e-87b2-75e7f3b5a9d1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:07.006807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 52/96] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/role_assignments?user.id=ecc7c7fa70a7464e9cd9aa6f926b633e&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=60c41aabe4694d07bf0b66f5223c3d0d => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:07.034578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:07.052146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd550-cbaa-40fb-a54d-54c1f729b3aa None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:07.100885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562176e-3ff0-4eb1-9512-fb8081ec2289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:07.101553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562176e-3ff0-4eb1-9512-fb8081ec2289 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:07.101844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562176e-3ff0-4eb1-9512-fb8081ec2289 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:07.102126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562176e-3ff0-4eb1-9512-fb8081ec2289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:07.102984 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562176e-3ff0-4eb1-9512-fb8081ec2289 None admin] RBAC: Adding query filter params (role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, scope.project.id=49987e6ce7ef437582cb75934ccf47d3, user.id=ecc7c7fa70a7464e9cd9aa6f926b633e) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:07.103306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562176e-3ff0-4eb1-9512-fb8081ec2289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:07.104805 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562176e-3ff0-4eb1-9512-fb8081ec2289 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:07.114955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 45/97] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/role_assignments?user.id=ecc7c7fa70a7464e9cd9aa6f926b633e&scope.project.id=49987e6ce7ef437582cb75934ccf47d3&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:07.980076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e754ee-4e74-4a24-95b7-ea30c581bfd6 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:07.980591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e754ee-4e74-4a24-95b7-ea30c581bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:07.980702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e754ee-4e74-4a24-95b7-ea30c581bfd6 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:07.982234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 53/98] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:07.987701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ec97d-28b8-4608-b4ce-930ac171ef9d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:07.988097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ec97d-28b8-4608-b4ce-930ac171ef9d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:07.988263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ec97d-28b8-4608-b4ce-930ac171ef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:08.010584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-461ec97d-28b8-4608-b4ce-930ac171ef9d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:08.011780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-461ec97d-28b8-4608-b4ce-930ac171ef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:08.083809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 46/99] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:08.393683 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e754ee-4e74-4a24-95b7-ea30c581bfd6 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:08.457686 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b1b0d-de2a-4afe-8373-a7a77bc204d9 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:08.458007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b1b0d-de2a-4afe-8373-a7a77bc204d9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:08.459973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b1b0d-de2a-4afe-8373-a7a77bc204d9 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:08.461789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 47/100] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:08.467537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4094-804a-42ef-a286-3e5e8afa3cbe None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:08.467835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4094-804a-42ef-a286-3e5e8afa3cbe None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:08.468118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4094-804a-42ef-a286-3e5e8afa3cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:08.495953 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ccac4094-804a-42ef-a286-3e5e8afa3cbe None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:08.497158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ccac4094-804a-42ef-a286-3e5e8afa3cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:08.560500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e754ee-4e74-4a24-95b7-ea30c581bfd6 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:08.568310 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:08.599166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378e637-95de-4512-bc07-cd5b29a21382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:08.600195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378e637-95de-4512-bc07-cd5b29a21382 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:08.600664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378e637-95de-4512-bc07-cd5b29a21382 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:08.601122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378e637-95de-4512-bc07-cd5b29a21382 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:08.602660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378e637-95de-4512-bc07-cd5b29a21382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:08.604443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378e637-95de-4512-bc07-cd5b29a21382 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:08.606244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 54/101] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:08.611104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:08.612730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378e637-95de-4512-bc07-cd5b29a21382 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:08.650748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 48/102] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:08.743060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378e637-95de-4512-bc07-cd5b29a21382 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:08.780490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c7982-e041-444f-9da9-18adb5767326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:08.781405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c7982-e041-444f-9da9-18adb5767326 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:08.781874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c7982-e041-444f-9da9-18adb5767326 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:08.782367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c7982-e041-444f-9da9-18adb5767326 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:08.783217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c7982-e041-444f-9da9-18adb5767326 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:08.784856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c7982-e041-444f-9da9-18adb5767326 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:08.876227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 55/103] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:26:08 2022] POST /identity/v3/projects => generated 302 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:09.073423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4094-804a-42ef-a286-3e5e8afa3cbe None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.187408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4094-804a-42ef-a286-3e5e8afa3cbe None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.224585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f86df2-7bd7-4ff7-bf3f-eb7c843fc73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:09.225281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86df2-7bd7-4ff7-bf3f-eb7c843fc73c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.225674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86df2-7bd7-4ff7-bf3f-eb7c843fc73c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.225985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86df2-7bd7-4ff7-bf3f-eb7c843fc73c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.236551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f86df2-7bd7-4ff7-bf3f-eb7c843fc73c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-e5f86df2-7bd7-4ff7-bf3f-eb7c843fc73c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:09.242222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:09.243069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:09.243840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 49/104] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:09.249519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c7982-e041-444f-9da9-18adb5767326 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.280507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.310264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efef4c0-ee41-4ec4-925a-d5b2a4209053 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.310879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efef4c0-ee41-4ec4-925a-d5b2a4209053 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.311359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efef4c0-ee41-4ec4-925a-d5b2a4209053 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.312902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 50/105] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:09.319702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4445fe-25b6-48b9-90f5-6fbab94f6705 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.320472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4445fe-25b6-48b9-90f5-6fbab94f6705 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.320972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4445fe-25b6-48b9-90f5-6fbab94f6705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.350398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1e4445fe-25b6-48b9-90f5-6fbab94f6705 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:09.351935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1e4445fe-25b6-48b9-90f5-6fbab94f6705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:09.359195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c7982-e041-444f-9da9-18adb5767326 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.397530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6f7d-5e56-41d0-b650-899d09d340c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:09.398157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6f7d-5e56-41d0-b650-899d09d340c6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.398483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6f7d-5e56-41d0-b650-899d09d340c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.398768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6f7d-5e56-41d0-b650-899d09d340c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.399575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6f7d-5e56-41d0-b650-899d09d340c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:09.399871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6f7d-5e56-41d0-b650-899d09d340c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:09.401332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6f7d-5e56-41d0-b650-899d09d340c6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:09.410249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 56/106] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:09.416715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6f7d-5e56-41d0-b650-899d09d340c6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.433003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.477812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 51/107] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:09.520812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.534216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6f7d-5e56-41d0-b650-899d09d340c6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.572006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2fb65-d2be-4c96-a599-3bc975dc0bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:09.572649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2fb65-d2be-4c96-a599-3bc975dc0bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.572984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2fb65-d2be-4c96-a599-3bc975dc0bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.573266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2fb65-d2be-4c96-a599-3bc975dc0bd6 None admin] PATH_INFO: `/v3/users/8824e4dd55a64898b31bbde0cdd7de57` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.588831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2fb65-d2be-4c96-a599-3bc975dc0bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=8824e4dd55a64898b31bbde0cdd7de57)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:09.590384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2fb65-d2be-4c96-a599-3bc975dc0bd6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:09.592373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 57/108] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/users/8824e4dd55a64898b31bbde0cdd7de57 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:09.597867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4445fe-25b6-48b9-90f5-6fbab94f6705 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.605993 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444173b-93fc-49cd-9e98-8456f1bbd621 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.606250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444173b-93fc-49cd-9e98-8456f1bbd621 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.606504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444173b-93fc-49cd-9e98-8456f1bbd621 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.608031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 58/109] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:09.613660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362c3d0-629f-4acd-922b-e48b78094600 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.613951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362c3d0-629f-4acd-922b-e48b78094600 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.614254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362c3d0-629f-4acd-922b-e48b78094600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.642807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-f362c3d0-629f-4acd-922b-e48b78094600 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:09.644082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f362c3d0-629f-4acd-922b-e48b78094600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:09.737618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 59/110] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:09.782008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4445fe-25b6-48b9-90f5-6fbab94f6705 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.827973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecf1cb-7e1f-4380-895d-0f06b90a6b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:09.828973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecf1cb-7e1f-4380-895d-0f06b90a6b91 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.829496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecf1cb-7e1f-4380-895d-0f06b90a6b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.829968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecf1cb-7e1f-4380-895d-0f06b90a6b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.865108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362c3d0-629f-4acd-922b-e48b78094600 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.906553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.958565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.982654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362c3d0-629f-4acd-922b-e48b78094600 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.988258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecf1cb-7e1f-4380-895d-0f06b90a6b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:09.989760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecf1cb-7e1f-4380-895d-0f06b90a6b91 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.022888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980009a6-f65c-47e5-9b22-b8763b581c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.024063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980009a6-f65c-47e5-9b22-b8763b581c3e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.024359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980009a6-f65c-47e5-9b22-b8763b581c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.024642 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980009a6-f65c-47e5-9b22-b8763b581c3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.037181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980009a6-f65c-47e5-9b22-b8763b581c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-980009a6-f65c-47e5-9b22-b8763b581c3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:10.044431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:10.045278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:10.046057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:10.046692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 60/111] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:10.053660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeeeec-0e5a-4861-8584-70e9c2c2661e None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.053954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeeeec-0e5a-4861-8584-70e9c2c2661e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.054280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeeeec-0e5a-4861-8584-70e9c2c2661e None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.055820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 61/112] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:10.056454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeeeec-0e5a-4861-8584-70e9c2c2661e None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.133070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 52/113] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:10.134462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47095b8d-69f6-4866-9b6d-f1c35fbb711f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.134861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47095b8d-69f6-4866-9b6d-f1c35fbb711f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.135246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47095b8d-69f6-4866-9b6d-f1c35fbb711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.160169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-47095b8d-69f6-4866-9b6d-f1c35fbb711f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:10.161842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-47095b8d-69f6-4866-9b6d-f1c35fbb711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:10.243417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 53/114] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:10.244186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47095b8d-69f6-4866-9b6d-f1c35fbb711f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeeeec-0e5a-4861-8584-70e9c2c2661e None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.249171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.292337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1199d12-1567-41b3-893b-09835e3aa5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.293534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199d12-1567-41b3-893b-09835e3aa5ec None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.294128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199d12-1567-41b3-893b-09835e3aa5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.294609 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199d12-1567-41b3-893b-09835e3aa5ec None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.295300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1199d12-1567-41b3-893b-09835e3aa5ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:10.295613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1199d12-1567-41b3-893b-09835e3aa5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.297016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1199d12-1567-41b3-893b-09835e3aa5ec None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.299798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.306747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 62/115] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:10.308819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1199d12-1567-41b3-893b-09835e3aa5ec None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.368861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47095b8d-69f6-4866-9b6d-f1c35fbb711f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.408050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008de1ad-04df-40bf-bbe5-6949e26af977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.408708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008de1ad-04df-40bf-bbe5-6949e26af977 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.409069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008de1ad-04df-40bf-bbe5-6949e26af977 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.409426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008de1ad-04df-40bf-bbe5-6949e26af977 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.410745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008de1ad-04df-40bf-bbe5-6949e26af977 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.412957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008de1ad-04df-40bf-bbe5-6949e26af977 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.414814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 54/116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:10.420954 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4d22-30af-45d2-817f-f5b41071f444 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.421337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4d22-30af-45d2-817f-f5b41071f444 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.421694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4d22-30af-45d2-817f-f5b41071f444 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.423239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 55/117] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:10.423855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b4d22-30af-45d2-817f-f5b41071f444 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.438028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1199d12-1567-41b3-893b-09835e3aa5ec None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.476219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce845bcd-8cc3-4e55-afa5-c8d868d6760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.476988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845bcd-8cc3-4e55-afa5-c8d868d6760c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.477350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845bcd-8cc3-4e55-afa5-c8d868d6760c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.477700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845bcd-8cc3-4e55-afa5-c8d868d6760c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.489749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce845bcd-8cc3-4e55-afa5-c8d868d6760c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-ce845bcd-8cc3-4e55-afa5-c8d868d6760c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:10.496841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:10.499078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 63/118] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:10.500893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce845bcd-8cc3-4e55-afa5-c8d868d6760c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.526394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.561232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b4d22-30af-45d2-817f-f5b41071f444 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.585928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.605535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c89c1-d720-483e-89a2-db888318f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.606459 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c89c1-d720-483e-89a2-db888318f157 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.606751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c89c1-d720-483e-89a2-db888318f157 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.607038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c89c1-d720-483e-89a2-db888318f157 None admin] PATH_INFO: `/v3/users/0beed70e660843e4af019f77be01b3fa` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.608278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c89c1-d720-483e-89a2-db888318f157 None admin] RBAC: Authorizing `identity:get_user(user_id=0beed70e660843e4af019f77be01b3fa)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.609743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c89c1-d720-483e-89a2-db888318f157 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.611372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 56/119] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/users/0beed70e660843e4af019f77be01b3fa => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:10.612485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8753e-4d83-4e9b-9fe6-243707e41c2a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.612775 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8753e-4d83-4e9b-9fe6-243707e41c2a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.613061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8753e-4d83-4e9b-9fe6-243707e41c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.633776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-93f8753e-4d83-4e9b-9fe6-243707e41c2a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:10.635046 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-93f8753e-4d83-4e9b-9fe6-243707e41c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:10.635152 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce845bcd-8cc3-4e55-afa5-c8d868d6760c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.674093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2a05-312d-44c6-89c0-8e4284af605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.674744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2a05-312d-44c6-89c0-8e4284af605e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.675064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2a05-312d-44c6-89c0-8e4284af605e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.675346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2a05-312d-44c6-89c0-8e4284af605e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.676083 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2a05-312d-44c6-89c0-8e4284af605e None admin] RBAC: Adding query filter params (role.id=7bf20f00c3594a4ab1e58f1b118fc3e8, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea, user.id=8824e4dd55a64898b31bbde0cdd7de57) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:10.676397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2a05-312d-44c6-89c0-8e4284af605e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.677858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2a05-312d-44c6-89c0-8e4284af605e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.691505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 64/120] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/role_assignments?user.id=8824e4dd55a64898b31bbde0cdd7de57&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=7bf20f00c3594a4ab1e58f1b118fc3e8 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:10.691505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2a05-312d-44c6-89c0-8e4284af605e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.740073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 57/121] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:10.741579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8753e-4d83-4e9b-9fe6-243707e41c2a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.870939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2a05-312d-44c6-89c0-8e4284af605e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.875406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.908660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8753e-4d83-4e9b-9fe6-243707e41c2a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.909483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.946017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5741a1-1850-4279-b744-7034440c9bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.946596 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5741a1-1850-4279-b744-7034440c9bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.946880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5741a1-1850-4279-b744-7034440c9bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.947156 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5741a1-1850-4279-b744-7034440c9bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.947832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5741a1-1850-4279-b744-7034440c9bb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:10.948141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5741a1-1850-4279-b744-7034440c9bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.950952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5741a1-1850-4279-b744-7034440c9bb6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.960265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cee0f-a53c-43db-a58b-087f9c191332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.960916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cee0f-a53c-43db-a58b-087f9c191332 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.961210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cee0f-a53c-43db-a58b-087f9c191332 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.961497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cee0f-a53c-43db-a58b-087f9c191332 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.970524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 65/122] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:10.971370 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5741a1-1850-4279-b744-7034440c9bb6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.980599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cee0f-a53c-43db-a58b-087f9c191332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c67cee0f-a53c-43db-a58b-087f9c191332 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:10.989670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:10.990819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:10.991868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:10.995174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 58/123] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:10.995778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cee0f-a53c-43db-a58b-087f9c191332 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.107689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5741a1-1850-4279-b744-7034440c9bb6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.132732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cee0f-a53c-43db-a58b-087f9c191332 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.141860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9bb19-994a-4888-b8b3-9219d48b3020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.142536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9bb19-994a-4888-b8b3-9219d48b3020 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.142824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9bb19-994a-4888-b8b3-9219d48b3020 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.143105 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9bb19-994a-4888-b8b3-9219d48b3020 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.144233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9bb19-994a-4888-b8b3-9219d48b3020 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.145685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9bb19-994a-4888-b8b3-9219d48b3020 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.148172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 66/124] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.148723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9bb19-994a-4888-b8b3-9219d48b3020 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.170527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.179101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb573d44-0657-44c0-a9da-9de6d67b719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.180028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb573d44-0657-44c0-a9da-9de6d67b719b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.180506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb573d44-0657-44c0-a9da-9de6d67b719b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.181023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb573d44-0657-44c0-a9da-9de6d67b719b None admin] PATH_INFO: `/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.182496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb573d44-0657-44c0-a9da-9de6d67b719b None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c7fa70a7464e9cd9aa6f926b633e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.184178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb573d44-0657-44c0-a9da-9de6d67b719b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.186072 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 59/125] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.187422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb573d44-0657-44c0-a9da-9de6d67b719b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.210704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.260935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9bb19-994a-4888-b8b3-9219d48b3020 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.296653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba30dd4-ee58-41e9-8f53-3e8619f581c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.297307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba30dd4-ee58-41e9-8f53-3e8619f581c4 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.297536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba30dd4-ee58-41e9-8f53-3e8619f581c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.297814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba30dd4-ee58-41e9-8f53-3e8619f581c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.298513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba30dd4-ee58-41e9-8f53-3e8619f581c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:11.298896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba30dd4-ee58-41e9-8f53-3e8619f581c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.300218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba30dd4-ee58-41e9-8f53-3e8619f581c4 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.309384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 67/126] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.310161 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba30dd4-ee58-41e9-8f53-3e8619f581c4 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.311424 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb573d44-0657-44c0-a9da-9de6d67b719b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.351995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffab645-d56a-4fcd-b0c6-ddbb1db92093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.353116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffab645-d56a-4fcd-b0c6-ddbb1db92093 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.353597 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffab645-d56a-4fcd-b0c6-ddbb1db92093 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.354066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffab645-d56a-4fcd-b0c6-ddbb1db92093 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.366806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffab645-d56a-4fcd-b0c6-ddbb1db92093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-fffab645-d56a-4fcd-b0c6-ddbb1db92093 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:11.372812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:11.373700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:11.374518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:11.376980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 60/127] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:11.377983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffab645-d56a-4fcd-b0c6-ddbb1db92093 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.418385 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba30dd4-ee58-41e9-8f53-3e8619f581c4 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.433389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.449233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.454864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcad5a-7287-4844-ac38-d816eedef152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.455538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcad5a-7287-4844-ac38-d816eedef152 None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.455824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcad5a-7287-4844-ac38-d816eedef152 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.456160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcad5a-7287-4844-ac38-d816eedef152 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/users/0beed70e660843e4af019f77be01b3fa/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.458153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcad5a-7287-4844-ac38-d816eedef152 None admin] RBAC: Authorizing `identity:create_grant(project_id=e608f657ec954895ae35c7bd1b8fa6ea, user_id=0beed70e660843e4af019f77be01b3fa, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.460398 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcad5a-7287-4844-ac38-d816eedef152 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.495353 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffab645-d56a-4fcd-b0c6-ddbb1db92093 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.525668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 68/128] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:11 2022] PUT /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/users/0beed70e660843e4af019f77be01b3fa/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:11.527607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcad5a-7287-4844-ac38-d816eedef152 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.534523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028644b7-c29e-4bed-a128-a5e45ee908ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.535193 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028644b7-c29e-4bed-a128-a5e45ee908ae None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.535475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028644b7-c29e-4bed-a128-a5e45ee908ae None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.535752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028644b7-c29e-4bed-a128-a5e45ee908ae None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.536972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028644b7-c29e-4bed-a128-a5e45ee908ae None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.539276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028644b7-c29e-4bed-a128-a5e45ee908ae None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.541828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 61/129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.542631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028644b7-c29e-4bed-a128-a5e45ee908ae None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.714846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcad5a-7287-4844-ac38-d816eedef152 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.730560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028644b7-c29e-4bed-a128-a5e45ee908ae None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.758463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deb1c9-85a3-459c-9e55-1e3168aad539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.759203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb1c9-85a3-459c-9e55-1e3168aad539 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.759614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb1c9-85a3-459c-9e55-1e3168aad539 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.759990 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb1c9-85a3-459c-9e55-1e3168aad539 None admin] PATH_INFO: `/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.761473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deb1c9-85a3-459c-9e55-1e3168aad539 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c7fa70a7464e9cd9aa6f926b633e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.770224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deb1c9-85a3-459c-9e55-1e3168aad539 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.770224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 69/130] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.770224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deb1c9-85a3-459c-9e55-1e3168aad539 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.770515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.789217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0979e9-d817-4a23-b9cc-2bd492f6765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.789847 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0979e9-d817-4a23-b9cc-2bd492f6765c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.790133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0979e9-d817-4a23-b9cc-2bd492f6765c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.790438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0979e9-d817-4a23-b9cc-2bd492f6765c None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.791121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0979e9-d817-4a23-b9cc-2bd492f6765c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:11.791434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0979e9-d817-4a23-b9cc-2bd492f6765c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.793212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0979e9-d817-4a23-b9cc-2bd492f6765c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.810903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 62/131] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.811536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0979e9-d817-4a23-b9cc-2bd492f6765c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.844185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.906123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deb1c9-85a3-459c-9e55-1e3168aad539 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.947329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf48a9b-00e7-4e11-8bca-ed5761cc268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.947974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0979e9-d817-4a23-b9cc-2bd492f6765c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.948571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf48a9b-00e7-4e11-8bca-ed5761cc268a None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.949083 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf48a9b-00e7-4e11-8bca-ed5761cc268a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.949615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf48a9b-00e7-4e11-8bca-ed5761cc268a None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/users/ecc7c7fa70a7464e9cd9aa6f926b633e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.951929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf48a9b-00e7-4e11-8bca-ed5761cc268a None admin] RBAC: Authorizing `identity:create_grant(project_id=e608f657ec954895ae35c7bd1b8fa6ea, user_id=ecc7c7fa70a7464e9cd9aa6f926b633e, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.953584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf48a9b-00e7-4e11-8bca-ed5761cc268a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.984680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ee45d-4ac6-48b3-b382-063750fc718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.985326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ee45d-4ac6-48b3-b382-063750fc718c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.985615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ee45d-4ac6-48b3-b382-063750fc718c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.985893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ee45d-4ac6-48b3-b382-063750fc718c None admin] PATH_INFO: `/v3/projects/49987e6ce7ef437582cb75934ccf47d3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.987107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ee45d-4ac6-48b3-b382-063750fc718c None admin] RBAC: Authorizing `identity:get_project(project_id=49987e6ce7ef437582cb75934ccf47d3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.988580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ee45d-4ac6-48b3-b382-063750fc718c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.995567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 63/132] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/projects/49987e6ce7ef437582cb75934ccf47d3 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.995567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ee45d-4ac6-48b3-b382-063750fc718c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:12.057241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:12.072108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 70/133] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:11 2022] PUT /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/users/ecc7c7fa70a7464e9cd9aa6f926b633e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:12.073830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf6884-fa8a-4bbd-9ea4-35f039c6ace7 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.076938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf6884-fa8a-4bbd-9ea4-35f039c6ace7 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.077435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf6884-fa8a-4bbd-9ea4-35f039c6ace7 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.084094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 71/134] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:12.086346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf6884-fa8a-4bbd-9ea4-35f039c6ace7 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:12.134832 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ee45d-4ac6-48b3-b382-063750fc718c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:12.186215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e97d3-6222-4f26-a69c-88d72dafab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:12.186215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e97d3-6222-4f26-a69c-88d72dafab89 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.186215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e97d3-6222-4f26-a69c-88d72dafab89 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.186215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e97d3-6222-4f26-a69c-88d72dafab89 None admin] PATH_INFO: `/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.187656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e97d3-6222-4f26-a69c-88d72dafab89 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c7fa70a7464e9cd9aa6f926b633e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:12.191013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e97d3-6222-4f26-a69c-88d72dafab89 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:12.195469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 64/135] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:12.200069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a0570-2371-4b61-93ba-8745c664b095 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.200371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a0570-2371-4b61-93ba-8745c664b095 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.200655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a0570-2371-4b61-93ba-8745c664b095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.232087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8b5a0570-2371-4b61-93ba-8745c664b095 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:12.233445 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8b5a0570-2371-4b61-93ba-8745c664b095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:12.307639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf6884-fa8a-4bbd-9ea4-35f039c6ace7 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:12.314578 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:12.322085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 65/136] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:12.323188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a0570-2371-4b61-93ba-8745c664b095 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:12.350687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76659a1b-ce0c-4044-a133-7dca1606e0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:12.351754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76659a1b-ce0c-4044-a133-7dca1606e0df None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.352237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76659a1b-ce0c-4044-a133-7dca1606e0df None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.352733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76659a1b-ce0c-4044-a133-7dca1606e0df None admin] PATH_INFO: `/v3/projects/49987e6ce7ef437582cb75934ccf47d3/users/ecc7c7fa70a7464e9cd9aa6f926b633e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.354972 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76659a1b-ce0c-4044-a133-7dca1606e0df None admin] RBAC: Authorizing `identity:create_grant(project_id=49987e6ce7ef437582cb75934ccf47d3, user_id=ecc7c7fa70a7464e9cd9aa6f926b633e, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:12.361548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76659a1b-ce0c-4044-a133-7dca1606e0df None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:12.408952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:12.454809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 72/137] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:12 2022] PUT /identity/v3/projects/49987e6ce7ef437582cb75934ccf47d3/users/ecc7c7fa70a7464e9cd9aa6f926b633e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:12.457754 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a0570-2371-4b61-93ba-8745c664b095 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:12.501870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e2011-2b1f-4aed-b3cd-195eb83d8eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:12.502566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2011-2b1f-4aed-b3cd-195eb83d8eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.502862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2011-2b1f-4aed-b3cd-195eb83d8eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.503348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2011-2b1f-4aed-b3cd-195eb83d8eb1 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.506978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e2011-2b1f-4aed-b3cd-195eb83d8eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:12.508615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e2011-2b1f-4aed-b3cd-195eb83d8eb1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:12.510397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 66/138] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:12 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:12.517047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76659a1b-ce0c-4044-a133-7dca1606e0df None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:12.653225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76659a1b-ce0c-4044-a133-7dca1606e0df None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:12.692542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e2011-2b1f-4aed-b3cd-195eb83d8eb1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:12.698486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ac288-5aef-4c8b-8142-8c8a38e95817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:12.699559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ac288-5aef-4c8b-8142-8c8a38e95817 None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.700056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ac288-5aef-4c8b-8142-8c8a38e95817 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.700541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ac288-5aef-4c8b-8142-8c8a38e95817 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/users/ecc7c7fa70a7464e9cd9aa6f926b633e/roles/60c41aabe4694d07bf0b66f5223c3d0d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.704118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ac288-5aef-4c8b-8142-8c8a38e95817 None admin] RBAC: Authorizing `identity:create_grant(project_id=e608f657ec954895ae35c7bd1b8fa6ea, user_id=ecc7c7fa70a7464e9cd9aa6f926b633e, role_id=60c41aabe4694d07bf0b66f5223c3d0d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:12.705886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ac288-5aef-4c8b-8142-8c8a38e95817 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:12.793557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 73/139] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:12 2022] PUT /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/users/ecc7c7fa70a7464e9cd9aa6f926b633e/roles/60c41aabe4694d07bf0b66f5223c3d0d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:12.828990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e2011-2b1f-4aed-b3cd-195eb83d8eb1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:12.859781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:12.873214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da4d01-6320-4033-b796-4c8374008aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:12.874355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4d01-6320-4033-b796-4c8374008aaa None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.874355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4d01-6320-4033-b796-4c8374008aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.874618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4d01-6320-4033-b796-4c8374008aaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.875939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da4d01-6320-4033-b796-4c8374008aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:12.877306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da4d01-6320-4033-b796-4c8374008aaa None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:12.879110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 67/140] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:12.885800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ac288-5aef-4c8b-8142-8c8a38e95817 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:12.914714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:13.016297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ac288-5aef-4c8b-8142-8c8a38e95817 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:13.055572 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feb746-c407-4006-86c0-18850505fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:13.056196 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feb746-c407-4006-86c0-18850505fb4d None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:13.056537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feb746-c407-4006-86c0-18850505fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:13.056882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feb746-c407-4006-86c0-18850505fb4d None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:13.057614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13feb746-c407-4006-86c0-18850505fb4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:13.059091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13feb746-c407-4006-86c0-18850505fb4d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:13.088789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770812e-e912-4e58-a42c-933ff83611cf None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:13.089873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770812e-e912-4e58-a42c-933ff83611cf None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:13.089873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770812e-e912-4e58-a42c-933ff83611cf None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:13.091068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 68/141] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:13.095814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4abc76-79a2-4c7f-bb0e-8fd7522008e6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:13.096199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4abc76-79a2-4c7f-bb0e-8fd7522008e6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:13.096487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4abc76-79a2-4c7f-bb0e-8fd7522008e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:13.116890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7d4abc76-79a2-4c7f-bb0e-8fd7522008e6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:13.118475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7d4abc76-79a2-4c7f-bb0e-8fd7522008e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:13.164391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 74/142] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:12 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:13.225560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 69/143] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:13.633099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feb746-c407-4006-86c0-18850505fb4d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:13.726573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:13.751751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feb746-c407-4006-86c0-18850505fb4d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:13.791576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdce71-7ca4-45ac-a66c-26ca6b0ba468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:13.794478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdce71-7ca4-45ac-a66c-26ca6b0ba468 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:13.794478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdce71-7ca4-45ac-a66c-26ca6b0ba468 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:13.794478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdce71-7ca4-45ac-a66c-26ca6b0ba468 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:13.805031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdce71-7ca4-45ac-a66c-26ca6b0ba468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-9fcdce71-7ca4-45ac-a66c-26ca6b0ba468 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:13.809894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:13.810824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:13.811646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 75/144] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:13.817306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4abc76-79a2-4c7f-bb0e-8fd7522008e6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:13.933027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4abc76-79a2-4c7f-bb0e-8fd7522008e6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:13.962732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:13.981643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69da90c-df1d-42c5-8b12-2579c2f43a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:13.982306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da90c-df1d-42c5-8b12-2579c2f43a6e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:13.982594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da90c-df1d-42c5-8b12-2579c2f43a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:13.982872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da90c-df1d-42c5-8b12-2579c2f43a6e None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:13.983548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69da90c-df1d-42c5-8b12-2579c2f43a6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:13.983851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69da90c-df1d-42c5-8b12-2579c2f43a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:13.985246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69da90c-df1d-42c5-8b12-2579c2f43a6e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:13.997842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 70/145] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:14.003507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdce71-7ca4-45ac-a66c-26ca6b0ba468 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:14.080304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000321b-2c32-428a-8098-1d4744ce2942 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.080680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000321b-2c32-428a-8098-1d4744ce2942 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.080879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000321b-2c32-428a-8098-1d4744ce2942 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.082310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 71/146] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:14.088407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35cd17-0ab8-43bd-981e-333ca0076ea9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.088692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35cd17-0ab8-43bd-981e-333ca0076ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.088972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35cd17-0ab8-43bd-981e-333ca0076ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.115660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ea35cd17-0ab8-43bd-981e-333ca0076ea9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:14.116864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ea35cd17-0ab8-43bd-981e-333ca0076ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:14.144079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdce71-7ca4-45ac-a66c-26ca6b0ba468 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:14.188843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aba596-9b3b-43db-ab67-23e5af93a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:14.189424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba596-9b3b-43db-ab67-23e5af93a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.189709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba596-9b3b-43db-ab67-23e5af93a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.189986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba596-9b3b-43db-ab67-23e5af93a3f6 None admin] PATH_INFO: `/v3/users/8824e4dd55a64898b31bbde0cdd7de57` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.191710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aba596-9b3b-43db-ab67-23e5af93a3f6 None admin] RBAC: Authorizing `identity:get_user(user_id=8824e4dd55a64898b31bbde0cdd7de57)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:14.193981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aba596-9b3b-43db-ab67-23e5af93a3f6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:14.195765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 76/147] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:14 2022] GET /identity/v3/users/8824e4dd55a64898b31bbde0cdd7de57 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:14.201361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aba596-9b3b-43db-ab67-23e5af93a3f6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:14.220329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:14.299542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 72/148] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:14.341021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aba596-9b3b-43db-ab67-23e5af93a3f6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:14.385647 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7591c-c896-4383-b573-c53efc0d92ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:14.386308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7591c-c896-4383-b573-c53efc0d92ca None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.386594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7591c-c896-4383-b573-c53efc0d92ca None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.386864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7591c-c896-4383-b573-c53efc0d92ca None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.387996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7591c-c896-4383-b573-c53efc0d92ca None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:14.389444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7591c-c896-4383-b573-c53efc0d92ca None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:14.391085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 77/149] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:14 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:14.398642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35cd17-0ab8-43bd-981e-333ca0076ea9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:14.508392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35cd17-0ab8-43bd-981e-333ca0076ea9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:14.523632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:14.545396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f039e-a674-416f-a119-29fc9721f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:14.546404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f039e-a674-416f-a119-29fc9721f593 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.546874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f039e-a674-416f-a119-29fc9721f593 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.547329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f039e-a674-416f-a119-29fc9721f593 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/users/8824e4dd55a64898b31bbde0cdd7de57/roles/7bf20f00c3594a4ab1e58f1b118fc3e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.549504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f039e-a674-416f-a119-29fc9721f593 None admin] RBAC: Authorizing `identity:create_grant(project_id=e608f657ec954895ae35c7bd1b8fa6ea, user_id=8824e4dd55a64898b31bbde0cdd7de57, role_id=7bf20f00c3594a4ab1e58f1b118fc3e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:14.551149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f039e-a674-416f-a119-29fc9721f593 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:14.718170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 73/150] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:14 2022] PUT /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/users/8824e4dd55a64898b31bbde0cdd7de57/roles/7bf20f00c3594a4ab1e58f1b118fc3e8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:14.729474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7591c-c896-4383-b573-c53efc0d92ca None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:14.829475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:14.857032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7591c-c896-4383-b573-c53efc0d92ca None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:14.902493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dcdd2-c998-49f5-bdbb-b1a6653029d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:14.903241 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcdd2-c998-49f5-bdbb-b1a6653029d5 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.903523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcdd2-c998-49f5-bdbb-b1a6653029d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.903800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcdd2-c998-49f5-bdbb-b1a6653029d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.920982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dcdd2-c998-49f5-bdbb-b1a6653029d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-ff2dcdd2-c998-49f5-bdbb-b1a6653029d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:14.925771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:14.926693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:14.927508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 78/151] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:14.933880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f039e-a674-416f-a119-29fc9721f593 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.052262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f039e-a674-416f-a119-29fc9721f593 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:15.096171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e94889-1a0e-4465-9ddd-32be745c18f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:15.096723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e94889-1a0e-4465-9ddd-32be745c18f5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.097044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e94889-1a0e-4465-9ddd-32be745c18f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.097296 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e94889-1a0e-4465-9ddd-32be745c18f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.097956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e94889-1a0e-4465-9ddd-32be745c18f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:15.098284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e94889-1a0e-4465-9ddd-32be745c18f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:15.100198 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e94889-1a0e-4465-9ddd-32be745c18f5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:15.114070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 74/152] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:15.120189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dcdd2-c998-49f5-bdbb-b1a6653029d5 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.202900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c670-39c4-44fe-b648-b8366e2ffe13 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.203226 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c670-39c4-44fe-b648-b8366e2ffe13 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.203464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c670-39c4-44fe-b648-b8366e2ffe13 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.205084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 75/153] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:15.236484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367ee86-8e0c-46e8-82ff-6fbf2a7226de None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.236782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367ee86-8e0c-46e8-82ff-6fbf2a7226de None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.237050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367ee86-8e0c-46e8-82ff-6fbf2a7226de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.257525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dcdd2-c998-49f5-bdbb-b1a6653029d5 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:15.282116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f367ee86-8e0c-46e8-82ff-6fbf2a7226de None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:15.283346 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f367ee86-8e0c-46e8-82ff-6fbf2a7226de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:15.294728 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552eb17-5c8a-4fb6-b46a-7ecbaaed8600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:15.295380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552eb17-5c8a-4fb6-b46a-7ecbaaed8600 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.295673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552eb17-5c8a-4fb6-b46a-7ecbaaed8600 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.295956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552eb17-5c8a-4fb6-b46a-7ecbaaed8600 None admin] PATH_INFO: `/v3/users/0beed70e660843e4af019f77be01b3fa` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.297556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552eb17-5c8a-4fb6-b46a-7ecbaaed8600 None admin] RBAC: Authorizing `identity:get_user(user_id=0beed70e660843e4af019f77be01b3fa)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:15.299093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552eb17-5c8a-4fb6-b46a-7ecbaaed8600 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:15.300749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 79/154] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:15 2022] GET /identity/v3/users/0beed70e660843e4af019f77be01b3fa => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:15.311544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552eb17-5c8a-4fb6-b46a-7ecbaaed8600 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.322535 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:15.357570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:15.447787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552eb17-5c8a-4fb6-b46a-7ecbaaed8600 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:15.468359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 76/155] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:15.490105 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4bf3-755e-4351-b289-b8b7c84b4f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:15.491286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4bf3-755e-4351-b289-b8b7c84b4f6a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.491569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4bf3-755e-4351-b289-b8b7c84b4f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.491854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4bf3-755e-4351-b289-b8b7c84b4f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.511280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e324f7b-9ca6-4b1d-85f3-9a3cb176c8f1 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.511842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e324f7b-9ca6-4b1d-85f3-9a3cb176c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.512327 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e324f7b-9ca6-4b1d-85f3-9a3cb176c8f1 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.513933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 77/156] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:15.520313 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9bbac-01e1-4b7c-b3f0-f0494d7a59a5 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.521043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9bbac-01e1-4b7c-b3f0-f0494d7a59a5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.521873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9bbac-01e1-4b7c-b3f0-f0494d7a59a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.560012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fbe9bbac-01e1-4b7c-b3f0-f0494d7a59a5 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:15.561536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fbe9bbac-01e1-4b7c-b3f0-f0494d7a59a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:15.594206 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee4bf3-755e-4351-b289-b8b7c84b4f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:15.595840 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee4bf3-755e-4351-b289-b8b7c84b4f6a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:15.598003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:15.746060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 80/157] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:26:15.752553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4bf3-755e-4351-b289-b8b7c84b4f6a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.794379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 78/158] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:15.909540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4bf3-755e-4351-b289-b8b7c84b4f6a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:15.911473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:15.956295 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a2a2-a800-43a1-a49f-a415c812e69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:15.956938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a2a2-a800-43a1-a49f-a415c812e69b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.957217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a2a2-a800-43a1-a49f-a415c812e69b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.957494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a2a2-a800-43a1-a49f-a415c812e69b None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.958691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3a2a2-a800-43a1-a49f-a415c812e69b None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:15.960413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3a2a2-a800-43a1-a49f-a415c812e69b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:15.962066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 81/159] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:15 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:15.968211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9bbac-01e1-4b7c-b3f0-f0494d7a59a5 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.115863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:16.122897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9bbac-01e1-4b7c-b3f0-f0494d7a59a5 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.167241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868e622-8ced-4199-800a-599a4509f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.167863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868e622-8ced-4199-800a-599a4509f072 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.168150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868e622-8ced-4199-800a-599a4509f072 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.168426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868e622-8ced-4199-800a-599a4509f072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.169158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868e622-8ced-4199-800a-599a4509f072 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea, user.id=0beed70e660843e4af019f77be01b3fa) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:16.169468 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868e622-8ced-4199-800a-599a4509f072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:16.170979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868e622-8ced-4199-800a-599a4509f072 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:16.183043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 79/160] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:15 2022] GET /identity/v3/role_assignments?user.id=0beed70e660843e4af019f77be01b3fa&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:16.226799 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a2a2-a800-43a1-a49f-a415c812e69b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.235429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868e622-8ced-4199-800a-599a4509f072 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.370643 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a2a2-a800-43a1-a49f-a415c812e69b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.409749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7a9d2-ab7a-4f34-abee-abd0cb8d3d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.410557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7a9d2-ab7a-4f34-abee-abd0cb8d3d17 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.411119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7a9d2-ab7a-4f34-abee-abd0cb8d3d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.411491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7a9d2-ab7a-4f34-abee-abd0cb8d3d17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.424725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7a9d2-ab7a-4f34-abee-abd0cb8d3d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-fdc7a9d2-ab7a-4f34-abee-abd0cb8d3d17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:16.430678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:16.431784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:16.432864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:16.434646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 82/161] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:16.441468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7a9d2-ab7a-4f34-abee-abd0cb8d3d17 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.506985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:16.564210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868e622-8ced-4199-800a-599a4509f072 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.585874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7a9d2-ab7a-4f34-abee-abd0cb8d3d17 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.628323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb44a-9d1d-4732-b979-a4c9a5bd74a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.628954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb44a-9d1d-4732-b979-a4c9a5bd74a7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.629794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb44a-9d1d-4732-b979-a4c9a5bd74a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.630074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb44a-9d1d-4732-b979-a4c9a5bd74a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.631303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebb44a-9d1d-4732-b979-a4c9a5bd74a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:16.631627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebb44a-9d1d-4732-b979-a4c9a5bd74a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:16.633215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebb44a-9d1d-4732-b979-a4c9a5bd74a7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:16.645490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 83/162] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:16.646800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c73552-b4e8-4a8e-b29a-f5a3c16046f9 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.647092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c73552-b4e8-4a8e-b29a-f5a3c16046f9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.647525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c73552-b4e8-4a8e-b29a-f5a3c16046f9 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.657209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 84/163] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:16.657854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c73552-b4e8-4a8e-b29a-f5a3c16046f9 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.674019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bfed2-9399-4f12-ad26-f26778ee3309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.674693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bfed2-9399-4f12-ad26-f26778ee3309 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.674978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bfed2-9399-4f12-ad26-f26778ee3309 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.675255 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bfed2-9399-4f12-ad26-f26778ee3309 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.699428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bfed2-9399-4f12-ad26-f26778ee3309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d22bfed2-9399-4f12-ad26-f26778ee3309 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:16.704432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:16.705378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:16.706154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:16.708319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 80/164] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 472 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:16.717271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91286d39-e615-401a-acc6-f3bb0f7ffa26 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.717572 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91286d39-e615-401a-acc6-f3bb0f7ffa26 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.717834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91286d39-e615-401a-acc6-f3bb0f7ffa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.755251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-91286d39-e615-401a-acc6-f3bb0f7ffa26 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:16.756537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-91286d39-e615-401a-acc6-f3bb0f7ffa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:16.776747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:16.830605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:16.841040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 81/165] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:16.841805 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91286d39-e615-401a-acc6-f3bb0f7ffa26 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.847455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c73552-b4e8-4a8e-b29a-f5a3c16046f9 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.911765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb75a3-9921-4c9f-b532-3d6205dc898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.913262 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb75a3-9921-4c9f-b532-3d6205dc898f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.913748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb75a3-9921-4c9f-b532-3d6205dc898f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.914254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb75a3-9921-4c9f-b532-3d6205dc898f None admin] PATH_INFO: `/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.918945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb75a3-9921-4c9f-b532-3d6205dc898f None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c7fa70a7464e9cd9aa6f926b633e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:16.920533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb75a3-9921-4c9f-b532-3d6205dc898f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:16.922366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 85/166] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:16.944051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb75a3-9921-4c9f-b532-3d6205dc898f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.960459 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91286d39-e615-401a-acc6-f3bb0f7ffa26 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.996213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c4d9-be6c-4ccf-99f6-a20fa3625d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.996849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c4d9-be6c-4ccf-99f6-a20fa3625d13 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.997172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c4d9-be6c-4ccf-99f6-a20fa3625d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.997456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c4d9-be6c-4ccf-99f6-a20fa3625d13 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.998131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213c4d9-be6c-4ccf-99f6-a20fa3625d13 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:16.998467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213c4d9-be6c-4ccf-99f6-a20fa3625d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:16.999892 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213c4d9-be6c-4ccf-99f6-a20fa3625d13 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.009875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 82/167] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:17.017977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c4d9-be6c-4ccf-99f6-a20fa3625d13 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.037778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.113303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb75a3-9921-4c9f-b532-3d6205dc898f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.191210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c4d9-be6c-4ccf-99f6-a20fa3625d13 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.207822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4676be-1f83-46fa-ad5c-caeee8e6f626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.208551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4676be-1f83-46fa-ad5c-caeee8e6f626 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.208752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4676be-1f83-46fa-ad5c-caeee8e6f626 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.209082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4676be-1f83-46fa-ad5c-caeee8e6f626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.250542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ea5e6-c91a-40e4-9077-ed92c4f3c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.251556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ea5e6-c91a-40e4-9077-ed92c4f3c13d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.252031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ea5e6-c91a-40e4-9077-ed92c4f3c13d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.252518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ea5e6-c91a-40e4-9077-ed92c4f3c13d None admin] PATH_INFO: `/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.253957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ea5e6-c91a-40e4-9077-ed92c4f3c13d None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c7fa70a7464e9cd9aa6f926b633e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.255621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ea5e6-c91a-40e4-9077-ed92c4f3c13d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.258355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 83/168] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:17.263749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ea5e6-c91a-40e4-9077-ed92c4f3c13d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.287294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.380693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.399274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4676be-1f83-46fa-ad5c-caeee8e6f626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.400773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4676be-1f83-46fa-ad5c-caeee8e6f626 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.410240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ea5e6-c91a-40e4-9077-ed92c4f3c13d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.463966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb149f5-7fba-481f-ac34-ebd35d14d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.464928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb149f5-7fba-481f-ac34-ebd35d14d947 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.465404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb149f5-7fba-481f-ac34-ebd35d14d947 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.465871 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb149f5-7fba-481f-ac34-ebd35d14d947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.563584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb149f5-7fba-481f-ac34-ebd35d14d947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.565752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb149f5-7fba-481f-ac34-ebd35d14d947 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.676919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 86/169] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:17.677645 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4676be-1f83-46fa-ad5c-caeee8e6f626 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.686843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.717374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 84/170] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:26:17.722499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb149f5-7fba-481f-ac34-ebd35d14d947 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.825331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb149f5-7fba-481f-ac34-ebd35d14d947 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.838569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.876688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4676be-1f83-46fa-ad5c-caeee8e6f626 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.913372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceded4e-34e9-4330-867f-ba03e03617cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.914123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceded4e-34e9-4330-867f-ba03e03617cd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.914435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceded4e-34e9-4330-867f-ba03e03617cd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.914933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceded4e-34e9-4330-867f-ba03e03617cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.917195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9cf71-1966-4c6e-9f7f-a039c336508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.917846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9cf71-1966-4c6e-9f7f-a039c336508c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.918128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9cf71-1966-4c6e-9f7f-a039c336508c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.918430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9cf71-1966-4c6e-9f7f-a039c336508c None admin] PATH_INFO: `/v3/projects/49987e6ce7ef437582cb75934ccf47d3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.919567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9cf71-1966-4c6e-9f7f-a039c336508c None admin] RBAC: Authorizing `identity:get_project(project_id=49987e6ce7ef437582cb75934ccf47d3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.921041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9cf71-1966-4c6e-9f7f-a039c336508c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.926226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceded4e-34e9-4330-867f-ba03e03617cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:17.931003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 85/171] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/projects/49987e6ce7ef437582cb75934ccf47d3 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-aceded4e-34e9-4330-867f-ba03e03617cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:17.931853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:17.932727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:17.933540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:17.934157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a317cd-15e4-4b4b-9099-9646be67cded None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.934157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a317cd-15e4-4b4b-9099-9646be67cded None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.934157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a317cd-15e4-4b4b-9099-9646be67cded None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.934744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 87/172] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:17.934744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceded4e-34e9-4330-867f-ba03e03617cd None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.934930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 86/173] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:17.941314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c471be9-a64a-4ab3-8a26-44b99b920b97 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.941600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c471be9-a64a-4ab3-8a26-44b99b920b97 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.941879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c471be9-a64a-4ab3-8a26-44b99b920b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.976138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2c471be9-a64a-4ab3-8a26-44b99b920b97 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:17.977258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2c471be9-a64a-4ab3-8a26-44b99b920b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:18.039842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceded4e-34e9-4330-867f-ba03e03617cd None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.060689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:18.076229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd3c70-6b18-42d5-b14e-a0a09e6350c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:18.081506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd3c70-6b18-42d5-b14e-a0a09e6350c5 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.081506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd3c70-6b18-42d5-b14e-a0a09e6350c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.081506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd3c70-6b18-42d5-b14e-a0a09e6350c5 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.081506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd3c70-6b18-42d5-b14e-a0a09e6350c5 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:18.081506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd3c70-6b18-42d5-b14e-a0a09e6350c5 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:18.082228 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 88/174] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:18.083000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd3c70-6b18-42d5-b14e-a0a09e6350c5 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:18.086525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:18.183458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 87/175] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:18.185023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c471be9-a64a-4ab3-8a26-44b99b920b97 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:18.209571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd3c70-6b18-42d5-b14e-a0a09e6350c5 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.250666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55a645-a163-4c29-a926-ebfc48e2945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:18.251507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55a645-a163-4c29-a926-ebfc48e2945d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.251935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55a645-a163-4c29-a926-ebfc48e2945d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.252512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55a645-a163-4c29-a926-ebfc48e2945d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.253392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55a645-a163-4c29-a926-ebfc48e2945d None admin] RBAC: Adding query filter params (role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, scope.project.id=49987e6ce7ef437582cb75934ccf47d3, user.id=ecc7c7fa70a7464e9cd9aa6f926b633e) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:18.253846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55a645-a163-4c29-a926-ebfc48e2945d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:18.256042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55a645-a163-4c29-a926-ebfc48e2945d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:18.262422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 89/176] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:18 2022] GET /identity/v3/role_assignments?user.id=ecc7c7fa70a7464e9cd9aa6f926b633e&scope.project.id=49987e6ce7ef437582cb75934ccf47d3&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:18.263774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55a645-a163-4c29-a926-ebfc48e2945d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:18.361147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:18.432843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55a645-a163-4c29-a926-ebfc48e2945d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.461052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c471be9-a64a-4ab3-8a26-44b99b920b97 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.479512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc79b0-1e7a-4949-8a11-154365427af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:18.480133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc79b0-1e7a-4949-8a11-154365427af6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.480545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc79b0-1e7a-4949-8a11-154365427af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.480826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc79b0-1e7a-4949-8a11-154365427af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.481570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc79b0-1e7a-4949-8a11-154365427af6 None admin] RBAC: Adding query filter params (role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea, user.id=ecc7c7fa70a7464e9cd9aa6f926b633e) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:18.481895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc79b0-1e7a-4949-8a11-154365427af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:18.483519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc79b0-1e7a-4949-8a11-154365427af6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:18.490967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 90/177] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:18 2022] GET /identity/v3/role_assignments?user.id=ecc7c7fa70a7464e9cd9aa6f926b633e&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:18.492227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2685f-e316-4c19-8216-88af2857a2dc None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.492514 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2685f-e316-4c19-8216-88af2857a2dc None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.492826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2685f-e316-4c19-8216-88af2857a2dc None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.494157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 91/178] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:18.495220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066480ef-c47c-4037-9a09-3a5124d7661f None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.495504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066480ef-c47c-4037-9a09-3a5124d7661f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.495782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066480ef-c47c-4037-9a09-3a5124d7661f None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.497029 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 92/179] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:18.498411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08427ced-5def-437a-98e5-13f793a7820f None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.504658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08427ced-5def-437a-98e5-13f793a7820f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.504658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08427ced-5def-437a-98e5-13f793a7820f None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.504658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 93/180] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:18.504658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad7c61-fd70-4ad9-a8ea-ac02ffc1b010 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.504658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad7c61-fd70-4ad9-a8ea-ac02ffc1b010 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.504658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad7c61-fd70-4ad9-a8ea-ac02ffc1b010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.518678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2e675-6fbc-48c9-9514-48a01796991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:18.519324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2e675-6fbc-48c9-9514-48a01796991e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.519606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2e675-6fbc-48c9-9514-48a01796991e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.519881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2e675-6fbc-48c9-9514-48a01796991e None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.520575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2e675-6fbc-48c9-9514-48a01796991e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:18.520880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2e675-6fbc-48c9-9514-48a01796991e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:18.522904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2e675-6fbc-48c9-9514-48a01796991e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:18.532672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-f4ad7c61-fd70-4ad9-a8ea-ac02ffc1b010 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:18.533596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 88/181] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:18.536119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f4ad7c61-fd70-4ad9-a8ea-ac02ffc1b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:18.536258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a1b6e-b9a6-482a-aade-e31b9dda946c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.536258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a1b6e-b9a6-482a-aade-e31b9dda946c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.536258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a1b6e-b9a6-482a-aade-e31b9dda946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.561365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-dc3a1b6e-b9a6-482a-aade-e31b9dda946c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:18.562641 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-dc3a1b6e-b9a6-482a-aade-e31b9dda946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:18.601241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:18.632448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 94/182] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:18.633561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1949c77-264b-4282-8158-b662c7128bf6 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.633863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1949c77-264b-4282-8158-b662c7128bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.638694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1949c77-264b-4282-8158-b662c7128bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.647788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 89/183] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:18.650048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a1b6e-b9a6-482a-aade-e31b9dda946c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:18.662621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a1949c77-264b-4282-8158-b662c7128bf6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:18.663841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a1949c77-264b-4282-8158-b662c7128bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:18.722347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:18.764894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 95/184] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:18.765721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1949c77-264b-4282-8158-b662c7128bf6 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:18.791079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a1b6e-b9a6-482a-aade-e31b9dda946c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.832053 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abdda-7c25-4f58-a1db-e9195420ba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:18.833147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abdda-7c25-4f58-a1db-e9195420ba28 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.833673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abdda-7c25-4f58-a1db-e9195420ba28 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.834362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abdda-7c25-4f58-a1db-e9195420ba28 None admin] PATH_INFO: `/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.835897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68abdda-7c25-4f58-a1db-e9195420ba28 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c7fa70a7464e9cd9aa6f926b633e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:18.837669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68abdda-7c25-4f58-a1db-e9195420ba28 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:18.839614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 90/185] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:18 2022] GET /identity/v3/users/ecc7c7fa70a7464e9cd9aa6f926b633e => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:18.847139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abdda-7c25-4f58-a1db-e9195420ba28 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:18.888036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:18.890813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1949c77-264b-4282-8158-b662c7128bf6 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.953592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98935193-a142-43fb-9b97-c41510ee5d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:18.954623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98935193-a142-43fb-9b97-c41510ee5d29 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.955104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98935193-a142-43fb-9b97-c41510ee5d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.955605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98935193-a142-43fb-9b97-c41510ee5d29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.970254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98935193-a142-43fb-9b97-c41510ee5d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:18.974404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abdda-7c25-4f58-a1db-e9195420ba28 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-98935193-a142-43fb-9b97-c41510ee5d29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:18.975329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:18.976324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:18.977119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 96/186] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:18.977803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98935193-a142-43fb-9b97-c41510ee5d29 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.020550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.022182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097e9f3-315a-46b1-923c-b20d53e74d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.023150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097e9f3-315a-46b1-923c-b20d53e74d64 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.023449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097e9f3-315a-46b1-923c-b20d53e74d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.023732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097e9f3-315a-46b1-923c-b20d53e74d64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.098503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98935193-a142-43fb-9b97-c41510ee5d29 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.105340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097e9f3-315a-46b1-923c-b20d53e74d64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.106882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097e9f3-315a-46b1-923c-b20d53e74d64 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.135439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210d95d-8b8f-4e7b-b7a9-bc0582f65c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.136074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210d95d-8b8f-4e7b-b7a9-bc0582f65c0f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.136356 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210d95d-8b8f-4e7b-b7a9-bc0582f65c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.136628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210d95d-8b8f-4e7b-b7a9-bc0582f65c0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.137729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210d95d-8b8f-4e7b-b7a9-bc0582f65c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.139210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210d95d-8b8f-4e7b-b7a9-bc0582f65c0f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.140010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.140762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 97/187] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.145884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210d95d-8b8f-4e7b-b7a9-bc0582f65c0f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.208415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 91/188] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:19.209969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097e9f3-315a-46b1-923c-b20d53e74d64 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.252255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210d95d-8b8f-4e7b-b7a9-bc0582f65c0f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.254532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.286223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4769424-1b64-408c-9132-077c7011c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.286766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4769424-1b64-408c-9132-077c7011c8cc None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.287183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4769424-1b64-408c-9132-077c7011c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.287586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4769424-1b64-408c-9132-077c7011c8cc None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.288258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4769424-1b64-408c-9132-077c7011c8cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:19.288565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4769424-1b64-408c-9132-077c7011c8cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.289942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4769424-1b64-408c-9132-077c7011c8cc None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.298428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 98/189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.303652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4769424-1b64-408c-9132-077c7011c8cc None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.307446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097e9f3-315a-46b1-923c-b20d53e74d64 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.342018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bde0f6-d733-439f-a3fe-f5a37305289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.342679 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bde0f6-d733-439f-a3fe-f5a37305289a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.342962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bde0f6-d733-439f-a3fe-f5a37305289a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.343234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bde0f6-d733-439f-a3fe-f5a37305289a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.345742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.353990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bde0f6-d733-439f-a3fe-f5a37305289a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-88bde0f6-d733-439f-a3fe-f5a37305289a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:19.358762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:19.359699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 92/190] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:19.365685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bde0f6-d733-439f-a3fe-f5a37305289a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.403382 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4769424-1b64-408c-9132-077c7011c8cc None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.436025 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ec18b-21e4-447d-8d2e-f6cc2827a0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.436655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ec18b-21e4-447d-8d2e-f6cc2827a0ae None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.436938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ec18b-21e4-447d-8d2e-f6cc2827a0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.437213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ec18b-21e4-447d-8d2e-f6cc2827a0ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.448306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ec18b-21e4-447d-8d2e-f6cc2827a0ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-a30ec18b-21e4-447d-8d2e-f6cc2827a0ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:19.453401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:19.454297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:19.455107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 99/191] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:19.455746 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ec18b-21e4-447d-8d2e-f6cc2827a0ae None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.464992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bde0f6-d733-439f-a3fe-f5a37305289a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.484877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.499386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c17f88-3485-45d5-bbb9-a80ebc642e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.499995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c17f88-3485-45d5-bbb9-a80ebc642e18 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.500277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c17f88-3485-45d5-bbb9-a80ebc642e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.500551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c17f88-3485-45d5-bbb9-a80ebc642e18 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.501192 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c17f88-3485-45d5-bbb9-a80ebc642e18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.502682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c17f88-3485-45d5-bbb9-a80ebc642e18 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.557760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ec18b-21e4-447d-8d2e-f6cc2827a0ae None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.590760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2676e8-75d6-46c1-9a38-fd045951d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.591383 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2676e8-75d6-46c1-9a38-fd045951d50c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.591665 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2676e8-75d6-46c1-9a38-fd045951d50c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.591939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2676e8-75d6-46c1-9a38-fd045951d50c None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.593039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2676e8-75d6-46c1-9a38-fd045951d50c None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.594530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2676e8-75d6-46c1-9a38-fd045951d50c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.596127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 100/192] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.596874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2676e8-75d6-46c1-9a38-fd045951d50c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.632508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 93/193] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:19 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:19.634751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c17f88-3485-45d5-bbb9-a80ebc642e18 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.693667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.703004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2676e8-75d6-46c1-9a38-fd045951d50c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.713918 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.751307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22e0b2-6fe6-4a58-ac47-f7e763e6bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.751964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22e0b2-6fe6-4a58-ac47-f7e763e6bbbe None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.752740 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22e0b2-6fe6-4a58-ac47-f7e763e6bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.753021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22e0b2-6fe6-4a58-ac47-f7e763e6bbbe None admin] PATH_INFO: `/v3/users/24d2f3b5109440a589d4c16e49ce03cc` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.766572 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c17f88-3485-45d5-bbb9-a80ebc642e18 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.772234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22e0b2-6fe6-4a58-ac47-f7e763e6bbbe None admin] RBAC: Authorizing `identity:get_user(user_id=24d2f3b5109440a589d4c16e49ce03cc)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.773712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22e0b2-6fe6-4a58-ac47-f7e763e6bbbe None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.781263 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 101/194] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/users/24d2f3b5109440a589d4c16e49ce03cc => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.781263 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22e0b2-6fe6-4a58-ac47-f7e763e6bbbe None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.807057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817fa01-f8d5-4167-8917-35dbe36bbc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.807584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817fa01-f8d5-4167-8917-35dbe36bbc12 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.807912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817fa01-f8d5-4167-8917-35dbe36bbc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.808012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817fa01-f8d5-4167-8917-35dbe36bbc12 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.808690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817fa01-f8d5-4167-8917-35dbe36bbc12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:19.809000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817fa01-f8d5-4167-8917-35dbe36bbc12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.810409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817fa01-f8d5-4167-8917-35dbe36bbc12 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.821635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 94/195] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.822347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817fa01-f8d5-4167-8917-35dbe36bbc12 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.900829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22e0b2-6fe6-4a58-ac47-f7e763e6bbbe None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.943211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec7643-eb2f-4840-aa08-5a259df8c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.943841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec7643-eb2f-4840-aa08-5a259df8c37d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.944325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec7643-eb2f-4840-aa08-5a259df8c37d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.944615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec7643-eb2f-4840-aa08-5a259df8c37d None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.945412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec7643-eb2f-4840-aa08-5a259df8c37d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:19.945718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec7643-eb2f-4840-aa08-5a259df8c37d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.947288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec7643-eb2f-4840-aa08-5a259df8c37d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.951055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817fa01-f8d5-4167-8917-35dbe36bbc12 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.956161 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 102/196] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.956999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec7643-eb2f-4840-aa08-5a259df8c37d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.968039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.974011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.994021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd3a43-2de2-413d-bc2d-1279217f0ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.994734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3a43-2de2-413d-bc2d-1279217f0ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.995020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3a43-2de2-413d-bc2d-1279217f0ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.995356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3a43-2de2-413d-bc2d-1279217f0ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.996099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd3a43-2de2-413d-bc2d-1279217f0ad6 None admin] RBAC: Adding query filter params (role.id=60c41aabe4694d07bf0b66f5223c3d0d, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea, user.id=ecc7c7fa70a7464e9cd9aa6f926b633e) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:19.996416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd3a43-2de2-413d-bc2d-1279217f0ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.998093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd3a43-2de2-413d-bc2d-1279217f0ad6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.005158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 95/197] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/role_assignments?user.id=ecc7c7fa70a7464e9cd9aa6f926b633e&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=60c41aabe4694d07bf0b66f5223c3d0d => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:20.006131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd3a43-2de2-413d-bc2d-1279217f0ad6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.087751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec7643-eb2f-4840-aa08-5a259df8c37d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.123186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd3a43-2de2-413d-bc2d-1279217f0ad6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.135590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7692-ba1e-4019-a3f0-6c51d27fdae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.136330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7692-ba1e-4019-a3f0-6c51d27fdae3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.136686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7692-ba1e-4019-a3f0-6c51d27fdae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.137039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7692-ba1e-4019-a3f0-6c51d27fdae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.163188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44294a81-09f4-4fed-85ac-fed3d3865ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.163949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294a81-09f4-4fed-85ac-fed3d3865ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.164337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294a81-09f4-4fed-85ac-fed3d3865ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.164715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294a81-09f4-4fed-85ac-fed3d3865ea3 None admin] PATH_INFO: `/v3/users/24d2f3b5109440a589d4c16e49ce03cc` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.166026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44294a81-09f4-4fed-85ac-fed3d3865ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=24d2f3b5109440a589d4c16e49ce03cc)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.167674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44294a81-09f4-4fed-85ac-fed3d3865ea3 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.169456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 96/198] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/users/24d2f3b5109440a589d4c16e49ce03cc => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:20.172857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44294a81-09f4-4fed-85ac-fed3d3865ea3 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.231013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.250505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7692-ba1e-4019-a3f0-6c51d27fdae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.252268 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7692-ba1e-4019-a3f0-6c51d27fdae3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.274544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.299139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44294a81-09f4-4fed-85ac-fed3d3865ea3 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.348230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed3d1-79af-4c42-a081-ae973236428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.350182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed3d1-79af-4c42-a081-ae973236428b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.350594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed3d1-79af-4c42-a081-ae973236428b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.350964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed3d1-79af-4c42-a081-ae973236428b None admin] PATH_INFO: `/v3/users/8824e4dd55a64898b31bbde0cdd7de57` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.352241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed3d1-79af-4c42-a081-ae973236428b None admin] RBAC: Authorizing `identity:get_user(user_id=8824e4dd55a64898b31bbde0cdd7de57)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.353769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed3d1-79af-4c42-a081-ae973236428b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.356223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 97/199] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/users/8824e4dd55a64898b31bbde0cdd7de57 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:20.357405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed3d1-79af-4c42-a081-ae973236428b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.394303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 103/200] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:20.395183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7692-ba1e-4019-a3f0-6c51d27fdae3 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.491613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed3d1-79af-4c42-a081-ae973236428b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.508890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.529541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7692-ba1e-4019-a3f0-6c51d27fdae3 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.534793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e904edd-b369-4e63-8107-f91590d044ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.535543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904edd-b369-4e63-8107-f91590d044ea None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.535931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904edd-b369-4e63-8107-f91590d044ea None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.536308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904edd-b369-4e63-8107-f91590d044ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.547653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.572601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96937c3c-d671-4d77-9395-448e4b40b2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.573545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96937c3c-d671-4d77-9395-448e4b40b2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.574280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96937c3c-d671-4d77-9395-448e4b40b2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.574935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96937c3c-d671-4d77-9395-448e4b40b2c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.624784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e904edd-b369-4e63-8107-f91590d044ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.626405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e904edd-b369-4e63-8107-f91590d044ea None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.662606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96937c3c-d671-4d77-9395-448e4b40b2c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.665116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96937c3c-d671-4d77-9395-448e4b40b2c1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.743107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 98/201] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:20.744241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e904edd-b369-4e63-8107-f91590d044ea None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.760615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.806059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 104/202] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:20.807268 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96937c3c-d671-4d77-9395-448e4b40b2c1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.825643 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.860338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e904edd-b369-4e63-8107-f91590d044ea None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.903635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d76e-32a2-4815-8e4f-36caa02fabfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.905259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d76e-32a2-4815-8e4f-36caa02fabfe None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.905654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d76e-32a2-4815-8e4f-36caa02fabfe None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.906035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d76e-32a2-4815-8e4f-36caa02fabfe None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.907326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8d76e-32a2-4815-8e4f-36caa02fabfe None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.908907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8d76e-32a2-4815-8e4f-36caa02fabfe None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.911201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 99/203] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:20.912593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d76e-32a2-4815-8e4f-36caa02fabfe None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.947362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96937c3c-d671-4d77-9395-448e4b40b2c1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.995390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5daa41-5a38-48f9-aee4-a9b7eb60d5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.996188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5daa41-5a38-48f9-aee4-a9b7eb60d5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.996566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5daa41-5a38-48f9-aee4-a9b7eb60d5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.996939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5daa41-5a38-48f9-aee4-a9b7eb60d5c2 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.998171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5daa41-5a38-48f9-aee4-a9b7eb60d5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:21.000260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5daa41-5a38-48f9-aee4-a9b7eb60d5c2 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:21.002747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 105/204] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:21.003834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5daa41-5a38-48f9-aee4-a9b7eb60d5c2 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:21.008364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:21.027936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d76e-32a2-4815-8e4f-36caa02fabfe None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:21.075250 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4fb02-b492-4689-8441-d6d234500f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:21.076034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4fb02-b492-4689-8441-d6d234500f84 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.076646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4fb02-b492-4689-8441-d6d234500f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.076930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4fb02-b492-4689-8441-d6d234500f84 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.078324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4fb02-b492-4689-8441-d6d234500f84 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:21.080542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4fb02-b492-4689-8441-d6d234500f84 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:21.082549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 100/205] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:21.083312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4fb02-b492-4689-8441-d6d234500f84 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:21.109210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:21.127987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5daa41-5a38-48f9-aee4-a9b7eb60d5c2 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:21.164394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab8633-e187-4d50-bcdb-8cff49b62963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:21.164941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8633-e187-4d50-bcdb-8cff49b62963 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.165221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8633-e187-4d50-bcdb-8cff49b62963 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.165497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8633-e187-4d50-bcdb-8cff49b62963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.166287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab8633-e187-4d50-bcdb-8cff49b62963 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54, user.id=24d2f3b5109440a589d4c16e49ce03cc) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:21.167210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab8633-e187-4d50-bcdb-8cff49b62963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:21.168098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab8633-e187-4d50-bcdb-8cff49b62963 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:21.182353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 106/206] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:21 2022] GET /identity/v3/role_assignments?user.id=24d2f3b5109440a589d4c16e49ce03cc&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:21.183428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab8633-e187-4d50-bcdb-8cff49b62963 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:21.212653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4fb02-b492-4689-8441-d6d234500f84 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:21.282848 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8490a1-8a32-4453-85d6-0b1503c2b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:21.283869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8490a1-8a32-4453-85d6-0b1503c2b000 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.284404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8490a1-8a32-4453-85d6-0b1503c2b000 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.284975 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8490a1-8a32-4453-85d6-0b1503c2b000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.285944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8490a1-8a32-4453-85d6-0b1503c2b000 None admin] RBAC: Adding query filter params (role.id=60c41aabe4694d07bf0b66f5223c3d0d, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54, user.id=24d2f3b5109440a589d4c16e49ce03cc) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:21.286489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8490a1-8a32-4453-85d6-0b1503c2b000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:21.288576 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8490a1-8a32-4453-85d6-0b1503c2b000 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:21.304958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 101/207] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:21 2022] GET /identity/v3/role_assignments?user.id=24d2f3b5109440a589d4c16e49ce03cc&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=60c41aabe4694d07bf0b66f5223c3d0d => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:21.305813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab8633-e187-4d50-bcdb-8cff49b62963 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:21.364342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698acd22-57b0-4664-95fe-049e1e94f583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:21.365503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698acd22-57b0-4664-95fe-049e1e94f583 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.366245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698acd22-57b0-4664-95fe-049e1e94f583 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.366592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698acd22-57b0-4664-95fe-049e1e94f583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.367339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698acd22-57b0-4664-95fe-049e1e94f583 None admin] RBAC: Adding query filter params (role.id=7bf20f00c3594a4ab1e58f1b118fc3e8, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea, user.id=8824e4dd55a64898b31bbde0cdd7de57) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:21.367708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698acd22-57b0-4664-95fe-049e1e94f583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:21.369183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698acd22-57b0-4664-95fe-049e1e94f583 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:21.376046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 107/208] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:21 2022] GET /identity/v3/role_assignments?user.id=8824e4dd55a64898b31bbde0cdd7de57&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=7bf20f00c3594a4ab1e58f1b118fc3e8 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:21.817774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0eaa-0a6b-44cf-9881-1de357d866ca None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.818834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0eaa-0a6b-44cf-9881-1de357d866ca None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.819106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0eaa-0a6b-44cf-9881-1de357d866ca None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.820484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 102/209] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:21.826050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9462c3-cbf2-43e9-80b3-bdaf04aa816e None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.826628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9462c3-cbf2-43e9-80b3-bdaf04aa816e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.827100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9462c3-cbf2-43e9-80b3-bdaf04aa816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.845943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-9b9462c3-cbf2-43e9-80b3-bdaf04aa816e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:21.847490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9b9462c3-cbf2-43e9-80b3-bdaf04aa816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:21.852187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:21.921548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 108/210] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:22.129503 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a09d-a965-4f2c-8f8a-80a0c2acd31e None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.129824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a09d-a965-4f2c-8f8a-80a0c2acd31e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.129994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a09d-a965-4f2c-8f8a-80a0c2acd31e None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.131611 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 103/211] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:22.136693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47afd9-f0d7-48b6-bfdf-99616a44e263 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.137119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47afd9-f0d7-48b6-bfdf-99616a44e263 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.137278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47afd9-f0d7-48b6-bfdf-99616a44e263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.156915 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ad47afd9-f0d7-48b6-bfdf-99616a44e263 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:22.158103 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ad47afd9-f0d7-48b6-bfdf-99616a44e263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:22.201511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a09d-a965-4f2c-8f8a-80a0c2acd31e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:22.218846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:22.243292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 109/212] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:22.311341 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a09d-a965-4f2c-8f8a-80a0c2acd31e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:22.346861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47310db4-48ec-49d7-8e6d-811706dfbeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:22.347541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47310db4-48ec-49d7-8e6d-811706dfbeba None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.347823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47310db4-48ec-49d7-8e6d-811706dfbeba None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.348100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47310db4-48ec-49d7-8e6d-811706dfbeba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.361142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47310db4-48ec-49d7-8e6d-811706dfbeba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-47310db4-48ec-49d7-8e6d-811706dfbeba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:22.368483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:22.369364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:22.370180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:22.374332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 104/213] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:22.377320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47afd9-f0d7-48b6-bfdf-99616a44e263 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:22.470623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:22.495368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47afd9-f0d7-48b6-bfdf-99616a44e263 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:22.531855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560738e8-600c-4fc7-81d5-777d8f3b3685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:22.532472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560738e8-600c-4fc7-81d5-777d8f3b3685 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.532813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560738e8-600c-4fc7-81d5-777d8f3b3685 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.533091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560738e8-600c-4fc7-81d5-777d8f3b3685 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.533817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560738e8-600c-4fc7-81d5-777d8f3b3685 None admin] RBAC: Adding query filter params (name=member) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:22.534127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560738e8-600c-4fc7-81d5-777d8f3b3685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:22.535570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560738e8-600c-4fc7-81d5-777d8f3b3685 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:22.543468 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47310db4-48ec-49d7-8e6d-811706dfbeba None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:22.545227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 110/214] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:22.552024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560738e8-600c-4fc7-81d5-777d8f3b3685 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:22.658461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560738e8-600c-4fc7-81d5-777d8f3b3685 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:22.658915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:22.688182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47310db4-48ec-49d7-8e6d-811706dfbeba None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:22.689379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:22.695248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958ef05-1f61-4d3a-be8c-16bac41cf9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:22.695886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958ef05-1f61-4d3a-be8c-16bac41cf9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.696172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958ef05-1f61-4d3a-be8c-16bac41cf9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.696523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958ef05-1f61-4d3a-be8c-16bac41cf9e0 None admin] PATH_INFO: `/v3/users/1ecddeac45ca4c3dabb32d40878e52ba` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.711662 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958ef05-1f61-4d3a-be8c-16bac41cf9e0 None admin] RBAC: Authorizing `identity:get_user(user_id=1ecddeac45ca4c3dabb32d40878e52ba)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:22.713150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958ef05-1f61-4d3a-be8c-16bac41cf9e0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:22.714855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 111/215] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:22 2022] GET /identity/v3/users/1ecddeac45ca4c3dabb32d40878e52ba => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:22.721149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958ef05-1f61-4d3a-be8c-16bac41cf9e0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:22.735741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034d6c5-4ab4-4fd6-a4b4-659011af11b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:22.736648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d6c5-4ab4-4fd6-a4b4-659011af11b8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.736911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d6c5-4ab4-4fd6-a4b4-659011af11b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.737192 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d6c5-4ab4-4fd6-a4b4-659011af11b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.738383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034d6c5-4ab4-4fd6-a4b4-659011af11b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:22.740538 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034d6c5-4ab4-4fd6-a4b4-659011af11b8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:22.742844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 105/216] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:22.748721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034d6c5-4ab4-4fd6-a4b4-659011af11b8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:22.840638 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958ef05-1f61-4d3a-be8c-16bac41cf9e0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:22.879131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d533055-9d18-421b-b262-26211715b431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:22.880141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533055-9d18-421b-b262-26211715b431 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.881396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533055-9d18-421b-b262-26211715b431 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.882298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533055-9d18-421b-b262-26211715b431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.884109 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034d6c5-4ab4-4fd6-a4b4-659011af11b8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:22.926285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c1682-115e-4983-8bd8-78cecbeb9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:22.927153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c1682-115e-4983-8bd8-78cecbeb9547 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.928148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c1682-115e-4983-8bd8-78cecbeb9547 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.928578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c1682-115e-4983-8bd8-78cecbeb9547 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.929518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c1682-115e-4983-8bd8-78cecbeb9547 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:22.931302 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c1682-115e-4983-8bd8-78cecbeb9547 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:22.955577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:22.966420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d533055-9d18-421b-b262-26211715b431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:22.967970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d533055-9d18-421b-b262-26211715b431 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:23.036209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:23.043416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 106/217] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:22 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:26:23.082751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 112/218] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:23.090307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c1682-115e-4983-8bd8-78cecbeb9547 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.202238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c1682-115e-4983-8bd8-78cecbeb9547 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.237394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ce711-2474-461d-8f22-0d7504467d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.238050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ce711-2474-461d-8f22-0d7504467d45 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.238366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ce711-2474-461d-8f22-0d7504467d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.238700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ce711-2474-461d-8f22-0d7504467d45 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.240856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7d58b-e18e-452c-8c51-bf5f53ecb0d2 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.241303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7d58b-e18e-452c-8c51-bf5f53ecb0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.241413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7d58b-e18e-452c-8c51-bf5f53ecb0d2 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.242922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 113/219] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:23.243122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ce711-2474-461d-8f22-0d7504467d45 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:23.244766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ce711-2474-461d-8f22-0d7504467d45 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:23.246902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 107/220] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:23.248070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e952-c2e7-498e-aaf2-cb1d8eb11605 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.249265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e952-c2e7-498e-aaf2-cb1d8eb11605 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.249265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e952-c2e7-498e-aaf2-cb1d8eb11605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.253218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ce711-2474-461d-8f22-0d7504467d45 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.270014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6054e952-c2e7-498e-aaf2-cb1d8eb11605 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:23.271411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6054e952-c2e7-498e-aaf2-cb1d8eb11605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:23.338442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:23.366152 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 114/221] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:23.386853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ce711-2474-461d-8f22-0d7504467d45 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.426959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2291cbb-1a95-419c-aa41-2d55010cbe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.428067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2291cbb-1a95-419c-aa41-2d55010cbe5b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.428553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2291cbb-1a95-419c-aa41-2d55010cbe5b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.429026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2291cbb-1a95-419c-aa41-2d55010cbe5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.429958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2291cbb-1a95-419c-aa41-2d55010cbe5b None admin] RBAC: Adding query filter params (role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54, user.id=1ecddeac45ca4c3dabb32d40878e52ba) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:23.430502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2291cbb-1a95-419c-aa41-2d55010cbe5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:23.432216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2291cbb-1a95-419c-aa41-2d55010cbe5b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:23.439211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 108/222] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/role_assignments?user.id=1ecddeac45ca4c3dabb32d40878e52ba&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:23.479855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061186e-a7c2-4d08-80e0-5edf69a57b57 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.480160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061186e-a7c2-4d08-80e0-5edf69a57b57 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.480405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061186e-a7c2-4d08-80e0-5edf69a57b57 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.481928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 115/223] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:23.487366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4877-5cb6-4eaa-964e-f93f0e90a237 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.487935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4877-5cb6-4eaa-964e-f93f0e90a237 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.488376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4877-5cb6-4eaa-964e-f93f0e90a237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.510692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3eda4877-5cb6-4eaa-964e-f93f0e90a237 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:23.511925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3eda4877-5cb6-4eaa-964e-f93f0e90a237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:23.602092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 109/224] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:23.656726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061186e-a7c2-4d08-80e0-5edf69a57b57 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.696069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:23.804424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061186e-a7c2-4d08-80e0-5edf69a57b57 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.848922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1892-ec40-4276-8598-5693a7f8dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.849891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1892-ec40-4276-8598-5693a7f8dc7f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.850415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1892-ec40-4276-8598-5693a7f8dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.850833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1892-ec40-4276-8598-5693a7f8dc7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.864585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d1892-ec40-4276-8598-5693a7f8dc7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-a71d1892-ec40-4276-8598-5693a7f8dc7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:23.869880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:23.870992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:23.872018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:23.873971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 116/225] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:23.879900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda4877-5cb6-4eaa-964e-f93f0e90a237 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.934043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1892-ec40-4276-8598-5693a7f8dc7f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.966637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.011410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda4877-5cb6-4eaa-964e-f93f0e90a237 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.050701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.058395 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac951-dce7-4b2e-ae33-433f73929b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.060134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac951-dce7-4b2e-ae33-433f73929b57 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.060134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac951-dce7-4b2e-ae33-433f73929b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.060134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac951-dce7-4b2e-ae33-433f73929b57 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.060355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ac951-dce7-4b2e-ae33-433f73929b57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:24.060564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ac951-dce7-4b2e-ae33-433f73929b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.062025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ac951-dce7-4b2e-ae33-433f73929b57 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.086365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 110/226] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:24.089987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac951-dce7-4b2e-ae33-433f73929b57 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.092903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1892-ec40-4276-8598-5693a7f8dc7f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.148357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2591f0-800c-4d7c-add6-98c1f84b21ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.149398 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2591f0-800c-4d7c-add6-98c1f84b21ad None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.149723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2591f0-800c-4d7c-add6-98c1f84b21ad None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.150004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2591f0-800c-4d7c-add6-98c1f84b21ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.161012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2591f0-800c-4d7c-add6-98c1f84b21ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-be2591f0-800c-4d7c-add6-98c1f84b21ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:24.166928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:24.167818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:24.168627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 117/227] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:24.178123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2591f0-800c-4d7c-add6-98c1f84b21ad None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.304661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac951-dce7-4b2e-ae33-433f73929b57 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.336914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2591f0-800c-4d7c-add6-98c1f84b21ad None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.344086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.374993 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d070fb6-7d4d-4367-b79a-7130b8de9488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.375711 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d070fb6-7d4d-4367-b79a-7130b8de9488 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.376003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d070fb6-7d4d-4367-b79a-7130b8de9488 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.376280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d070fb6-7d4d-4367-b79a-7130b8de9488 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.377046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d070fb6-7d4d-4367-b79a-7130b8de9488 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:24.377358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d070fb6-7d4d-4367-b79a-7130b8de9488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.378801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d070fb6-7d4d-4367-b79a-7130b8de9488 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.383418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3af78-eb8e-47c9-b953-3aa7946e5ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.384298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3af78-eb8e-47c9-b953-3aa7946e5ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.384795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3af78-eb8e-47c9-b953-3aa7946e5ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.385267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3af78-eb8e-47c9-b953-3aa7946e5ef1 None admin] PATH_INFO: `/v3/users/24d2f3b5109440a589d4c16e49ce03cc` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.387996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 118/228] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:24.388864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3af78-eb8e-47c9-b953-3aa7946e5ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=24d2f3b5109440a589d4c16e49ce03cc)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.390569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3af78-eb8e-47c9-b953-3aa7946e5ef1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.397922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d070fb6-7d4d-4367-b79a-7130b8de9488 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.397922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.398584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 111/229] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/users/24d2f3b5109440a589d4c16e49ce03cc => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:24.399659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3af78-eb8e-47c9-b953-3aa7946e5ef1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.502127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d070fb6-7d4d-4367-b79a-7130b8de9488 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.544557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5f767-cd1a-4c95-837e-48190486e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.544557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5f767-cd1a-4c95-837e-48190486e919 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.544557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5f767-cd1a-4c95-837e-48190486e919 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.544557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5f767-cd1a-4c95-837e-48190486e919 None admin] PATH_INFO: `/v3/users/24d2f3b5109440a589d4c16e49ce03cc` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.544969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5f767-cd1a-4c95-837e-48190486e919 None admin] RBAC: Authorizing `identity:get_user(user_id=24d2f3b5109440a589d4c16e49ce03cc)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.544969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5f767-cd1a-4c95-837e-48190486e919 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.544969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 119/230] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/users/24d2f3b5109440a589d4c16e49ce03cc => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:24.550779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5f767-cd1a-4c95-837e-48190486e919 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.615857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3af78-eb8e-47c9-b953-3aa7946e5ef1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.644677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.661078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5f767-cd1a-4c95-837e-48190486e919 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.686917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37537039-2170-47c3-9f91-d9b99689bef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.687596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37537039-2170-47c3-9f91-d9b99689bef1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.687878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37537039-2170-47c3-9f91-d9b99689bef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.694229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37537039-2170-47c3-9f91-d9b99689bef1 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.694229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37537039-2170-47c3-9f91-d9b99689bef1 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.694229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37537039-2170-47c3-9f91-d9b99689bef1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.694691 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 112/231] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:24.700648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37537039-2170-47c3-9f91-d9b99689bef1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.738747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357ec32-29d8-416f-aca9-27547df69e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.739392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357ec32-29d8-416f-aca9-27547df69e0b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.741149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357ec32-29d8-416f-aca9-27547df69e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.741500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357ec32-29d8-416f-aca9-27547df69e0b None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.745166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357ec32-29d8-416f-aca9-27547df69e0b None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.748152 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357ec32-29d8-416f-aca9-27547df69e0b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.752937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 120/232] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:24.756431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357ec32-29d8-416f-aca9-27547df69e0b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.817187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.863332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37537039-2170-47c3-9f91-d9b99689bef1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.901640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea97772-470e-431d-84d1-0e0f267baa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.902561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea97772-470e-431d-84d1-0e0f267baa0d None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.902845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea97772-470e-431d-84d1-0e0f267baa0d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.903119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea97772-470e-431d-84d1-0e0f267baa0d None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/users/24d2f3b5109440a589d4c16e49ce03cc/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.906466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea97772-470e-431d-84d1-0e0f267baa0d None admin] RBAC: Authorizing `identity:create_grant(project_id=73350d92b0dd475bbfeeb9bf45131a54, user_id=24d2f3b5109440a589d4c16e49ce03cc, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.907932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea97772-470e-431d-84d1-0e0f267baa0d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.951417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357ec32-29d8-416f-aca9-27547df69e0b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.987610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cba919-eef8-41c9-a327-6ffb977bbb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.988434 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cba919-eef8-41c9-a327-6ffb977bbb02 None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.988727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cba919-eef8-41c9-a327-6ffb977bbb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.989004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cba919-eef8-41c9-a327-6ffb977bbb02 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/users/24d2f3b5109440a589d4c16e49ce03cc/roles/60c41aabe4694d07bf0b66f5223c3d0d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.992004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cba919-eef8-41c9-a327-6ffb977bbb02 None admin] RBAC: Authorizing `identity:create_grant(project_id=73350d92b0dd475bbfeeb9bf45131a54, user_id=24d2f3b5109440a589d4c16e49ce03cc, role_id=60c41aabe4694d07bf0b66f5223c3d0d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.993377 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cba919-eef8-41c9-a327-6ffb977bbb02 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:25.013334 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 113/233] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:24 2022] PUT /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/users/24d2f3b5109440a589d4c16e49ce03cc/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:26:25.077598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:25.085659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 121/234] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:24 2022] PUT /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/users/24d2f3b5109440a589d4c16e49ce03cc/roles/60c41aabe4694d07bf0b66f5223c3d0d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:25.658777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798204-0641-4839-b32a-e60cc3c05044 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:25.659060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798204-0641-4839-b32a-e60cc3c05044 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:25.659607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798204-0641-4839-b32a-e60cc3c05044 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:25.661454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 114/235] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:25.663786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859dfd5-2be2-434a-b21b-261a1379468a None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:25.664612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859dfd5-2be2-434a-b21b-261a1379468a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:25.665085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859dfd5-2be2-434a-b21b-261a1379468a None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:25.666663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 122/236] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:25.671896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae947-b168-45da-bdf8-905617684519 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:25.672443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae947-b168-45da-bdf8-905617684519 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:25.672938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae947-b168-45da-bdf8-905617684519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:25.689532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a918bf-50db-4161-b6b5-63cfaa35b03b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:25.690147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a918bf-50db-4161-b6b5-63cfaa35b03b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:25.690920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a918bf-50db-4161-b6b5-63cfaa35b03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:25.711264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-62bae947-b168-45da-bdf8-905617684519 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:25.712490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-62bae947-b168-45da-bdf8-905617684519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:25.719204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-08a918bf-50db-4161-b6b5-63cfaa35b03b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:25.722697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-08a918bf-50db-4161-b6b5-63cfaa35b03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:25.784562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 115/237] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:25.786131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da432a-3562-44e5-b4b4-d59928784122 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:25.786587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da432a-3562-44e5-b4b4-d59928784122 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:25.787100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da432a-3562-44e5-b4b4-d59928784122 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:25.788514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 116/238] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:25.804208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a973b3-4f25-4270-945b-4e2ff843752f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:25.804693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a973b3-4f25-4270-945b-4e2ff843752f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:25.805115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a973b3-4f25-4270-945b-4e2ff843752f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:25.828830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 123/239] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:25.829888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d9a973b3-4f25-4270-945b-4e2ff843752f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:25.835617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d9a973b3-4f25-4270-945b-4e2ff843752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:25.906619 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:25.925074 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 117/240] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:26.173618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a918bf-50db-4161-b6b5-63cfaa35b03b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.274722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a973b3-4f25-4270-945b-4e2ff843752f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.307822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a918bf-50db-4161-b6b5-63cfaa35b03b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:26.339342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:26.350870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671974d-731a-43b9-989f-7f4aa5103d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:26.351679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671974d-731a-43b9-989f-7f4aa5103d6c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.351970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671974d-731a-43b9-989f-7f4aa5103d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.352254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671974d-731a-43b9-989f-7f4aa5103d6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.365144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671974d-731a-43b9-989f-7f4aa5103d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-2671974d-731a-43b9-989f-7f4aa5103d6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:26.369996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:26.371169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:26.372133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 124/241] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:26.372812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671974d-731a-43b9-989f-7f4aa5103d6c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.414220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a973b3-4f25-4270-945b-4e2ff843752f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:26.452700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ea356-5031-4a32-9e90-cab6714a3f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:26.453607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea356-5031-4a32-9e90-cab6714a3f1e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.454036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea356-5031-4a32-9e90-cab6714a3f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.454523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea356-5031-4a32-9e90-cab6714a3f1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.466293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ea356-5031-4a32-9e90-cab6714a3f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-699ea356-5031-4a32-9e90-cab6714a3f1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:26.471281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:26.472386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:26.473317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:26.475703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 118/242] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:26.481151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ea356-5031-4a32-9e90-cab6714a3f1e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.482470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671974d-731a-43b9-989f-7f4aa5103d6c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:26.519505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b600f6-b2d3-4c3f-88c4-10b21b51ca6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:26.520138 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b600f6-b2d3-4c3f-88c4-10b21b51ca6f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.520689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b600f6-b2d3-4c3f-88c4-10b21b51ca6f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.521707 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b600f6-b2d3-4c3f-88c4-10b21b51ca6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.523249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b600f6-b2d3-4c3f-88c4-10b21b51ca6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:26.524278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:26.525035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b600f6-b2d3-4c3f-88c4-10b21b51ca6f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:26.530337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 125/243] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:26.531782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b600f6-b2d3-4c3f-88c4-10b21b51ca6f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.590337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ea356-5031-4a32-9e90-cab6714a3f1e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:26.591967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:26.628200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9857c-1ea7-4e8a-a66f-1f1136d82298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:26.629054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9857c-1ea7-4e8a-a66f-1f1136d82298 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.629482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9857c-1ea7-4e8a-a66f-1f1136d82298 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.629927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9857c-1ea7-4e8a-a66f-1f1136d82298 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.631095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9857c-1ea7-4e8a-a66f-1f1136d82298 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:26.631551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9857c-1ea7-4e8a-a66f-1f1136d82298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:26.633148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9857c-1ea7-4e8a-a66f-1f1136d82298 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:26.638414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b600f6-b2d3-4c3f-88c4-10b21b51ca6f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:26.642678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 119/244] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:26.643824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9857c-1ea7-4e8a-a66f-1f1136d82298 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.675111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369aed8-7648-4f27-af6e-e7afad9eb368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:26.675714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369aed8-7648-4f27-af6e-e7afad9eb368 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.676149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369aed8-7648-4f27-af6e-e7afad9eb368 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.676596 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369aed8-7648-4f27-af6e-e7afad9eb368 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.677937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369aed8-7648-4f27-af6e-e7afad9eb368 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:26.678672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369aed8-7648-4f27-af6e-e7afad9eb368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:26.680238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369aed8-7648-4f27-af6e-e7afad9eb368 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:26.689111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 126/245] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:26.690231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369aed8-7648-4f27-af6e-e7afad9eb368 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.756937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:26.760470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9857c-1ea7-4e8a-a66f-1f1136d82298 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:26.798757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3379f-8004-4043-b0cf-6d4094f5d41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:26.799986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3379f-8004-4043-b0cf-6d4094f5d41d None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.800705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3379f-8004-4043-b0cf-6d4094f5d41d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.801163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3379f-8004-4043-b0cf-6d4094f5d41d None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.801994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3379f-8004-4043-b0cf-6d4094f5d41d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:26.802604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369aed8-7648-4f27-af6e-e7afad9eb368 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:26.803792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3379f-8004-4043-b0cf-6d4094f5d41d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:26.822833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:26.840345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d86df1-ba34-49af-bdef-c7089624a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:26.841014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d86df1-ba34-49af-bdef-c7089624a008 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.841294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d86df1-ba34-49af-bdef-c7089624a008 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.841568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d86df1-ba34-49af-bdef-c7089624a008 None admin] PATH_INFO: `/v3/users/1ecddeac45ca4c3dabb32d40878e52ba` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.842715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d86df1-ba34-49af-bdef-c7089624a008 None admin] RBAC: Authorizing `identity:get_user(user_id=1ecddeac45ca4c3dabb32d40878e52ba)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:26.844169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d86df1-ba34-49af-bdef-c7089624a008 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:26.845738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 127/246] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/users/1ecddeac45ca4c3dabb32d40878e52ba => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:26.846714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d86df1-ba34-49af-bdef-c7089624a008 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.918559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 120/247] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:26 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:26.922055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3379f-8004-4043-b0cf-6d4094f5d41d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.002414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d86df1-ba34-49af-bdef-c7089624a008 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.073864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c399c-a95c-4f93-bb6f-a1a8082ec2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.074729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c399c-a95c-4f93-bb6f-a1a8082ec2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.075012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c399c-a95c-4f93-bb6f-a1a8082ec2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.075287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c399c-a95c-4f93-bb6f-a1a8082ec2d0 None admin] PATH_INFO: `/v3/users/4b15621db9a747f3a6d56e892f14cc2c` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.108592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c399c-a95c-4f93-bb6f-a1a8082ec2d0 None admin] RBAC: Authorizing `identity:get_user(user_id=4b15621db9a747f3a6d56e892f14cc2c)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.110156 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c399c-a95c-4f93-bb6f-a1a8082ec2d0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.112100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 128/248] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/users/4b15621db9a747f3a6d56e892f14cc2c => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:27.118938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c399c-a95c-4f93-bb6f-a1a8082ec2d0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.149872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3379f-8004-4043-b0cf-6d4094f5d41d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.192282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:27.215885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8db5-d28d-444a-903a-5cab95b7621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.216541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8db5-d28d-444a-903a-5cab95b7621d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.216829 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8db5-d28d-444a-903a-5cab95b7621d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.217109 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8db5-d28d-444a-903a-5cab95b7621d None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.218398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd8db5-d28d-444a-903a-5cab95b7621d None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.220225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd8db5-d28d-444a-903a-5cab95b7621d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.225446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 121/249] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:27.226955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df992e40-0dab-460e-9885-2a5c72e0ba58 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.227452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df992e40-0dab-460e-9885-2a5c72e0ba58 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.228016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df992e40-0dab-460e-9885-2a5c72e0ba58 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.229583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 122/250] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:27.230504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df992e40-0dab-460e-9885-2a5c72e0ba58 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.259992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c399c-a95c-4f93-bb6f-a1a8082ec2d0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.267969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:27.313271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a6005-d381-41f6-941d-9dec3eb2b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.314011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6005-d381-41f6-941d-9dec3eb2b075 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.314330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6005-d381-41f6-941d-9dec3eb2b075 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.314608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6005-d381-41f6-941d-9dec3eb2b075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.379543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df992e40-0dab-460e-9885-2a5c72e0ba58 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.404583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a6005-d381-41f6-941d-9dec3eb2b075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.406260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a6005-d381-41f6-941d-9dec3eb2b075 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.424217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc962430-e5a4-4823-ae52-ab10a369172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.425196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc962430-e5a4-4823-ae52-ab10a369172f None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.425508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc962430-e5a4-4823-ae52-ab10a369172f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.425973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc962430-e5a4-4823-ae52-ab10a369172f None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/users/1ecddeac45ca4c3dabb32d40878e52ba/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.429869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc962430-e5a4-4823-ae52-ab10a369172f None admin] RBAC: Authorizing `identity:create_grant(project_id=73350d92b0dd475bbfeeb9bf45131a54, user_id=1ecddeac45ca4c3dabb32d40878e52ba, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.431943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc962430-e5a4-4823-ae52-ab10a369172f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.457160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:27.500703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 123/251] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:27 2022] PUT /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/users/1ecddeac45ca4c3dabb32d40878e52ba/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:27.501902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c48ef8-45af-4369-9f08-6ea8c5a807c1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.502276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c48ef8-45af-4369-9f08-6ea8c5a807c1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.502562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c48ef8-45af-4369-9f08-6ea8c5a807c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.523766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-13c48ef8-45af-4369-9f08-6ea8c5a807c1 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:27.525091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-13c48ef8-45af-4369-9f08-6ea8c5a807c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:27.532627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 129/252] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:27.534144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef0380-b6a4-40a4-9fdf-acf3b98cd493 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.534545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef0380-b6a4-40a4-9fdf-acf3b98cd493 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.534868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef0380-b6a4-40a4-9fdf-acf3b98cd493 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.536210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 130/253] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:27.537209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef0380-b6a4-40a4-9fdf-acf3b98cd493 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.606183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 124/254] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:27.607585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dac395-4e62-4ba3-985f-6a623088d1f0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.607881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dac395-4e62-4ba3-985f-6a623088d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.608203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dac395-4e62-4ba3-985f-6a623088d1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.647516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-36dac395-4e62-4ba3-985f-6a623088d1f0 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:27.648733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-36dac395-4e62-4ba3-985f-6a623088d1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:27.663648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:27.760698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef0380-b6a4-40a4-9fdf-acf3b98cd493 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.762667 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 125/255] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:27.802984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b6ad-d8c2-4250-a211-debcb53cd5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.803678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b6ad-d8c2-4250-a211-debcb53cd5bb None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.803962 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b6ad-d8c2-4250-a211-debcb53cd5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.804239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b6ad-d8c2-4250-a211-debcb53cd5bb None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.807925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44b6ad-d8c2-4250-a211-debcb53cd5bb None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.809615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44b6ad-d8c2-4250-a211-debcb53cd5bb None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.811739 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 131/256] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:27 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:27.817730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dac395-4e62-4ba3-985f-6a623088d1f0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.925916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dac395-4e62-4ba3-985f-6a623088d1f0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.962937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95853-ea2d-4ac4-ab45-9352f33a8957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.963560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95853-ea2d-4ac4-ab45-9352f33a8957 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.963849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95853-ea2d-4ac4-ab45-9352f33a8957 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.964123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95853-ea2d-4ac4-ab45-9352f33a8957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.964863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e95853-ea2d-4ac4-ab45-9352f33a8957 None admin] RBAC: Adding query filter params (role.id=7bf20f00c3594a4ab1e58f1b118fc3e8, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54, user.id=4b15621db9a747f3a6d56e892f14cc2c) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:27.965174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e95853-ea2d-4ac4-ab45-9352f33a8957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.966678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e95853-ea2d-4ac4-ab45-9352f33a8957 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.972809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 126/257] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:27 2022] GET /identity/v3/role_assignments?user.id=4b15621db9a747f3a6d56e892f14cc2c&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=7bf20f00c3594a4ab1e58f1b118fc3e8 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:27.999696 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b6ad-d8c2-4250-a211-debcb53cd5bb None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.016327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:28.116049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b6ad-d8c2-4250-a211-debcb53cd5bb None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.153769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552c4f1-7c86-4153-a41e-2eedf10348b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.154809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552c4f1-7c86-4153-a41e-2eedf10348b8 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.155284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552c4f1-7c86-4153-a41e-2eedf10348b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.155746 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552c4f1-7c86-4153-a41e-2eedf10348b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.166864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552c4f1-7c86-4153-a41e-2eedf10348b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-2552c4f1-7c86-4153-a41e-2eedf10348b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:28.171867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:28.172753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:28.173569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:28.175866 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 132/258] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:28.182596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95853-ea2d-4ac4-ab45-9352f33a8957 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.195143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:28.201676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552c4f1-7c86-4153-a41e-2eedf10348b8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.298575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:28.329503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552c4f1-7c86-4153-a41e-2eedf10348b8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.364757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdf0df-919a-4ab4-8c73-a665aea5bdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.365747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdf0df-919a-4ab4-8c73-a665aea5bdab None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.366283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdf0df-919a-4ab4-8c73-a665aea5bdab None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.366753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdf0df-919a-4ab4-8c73-a665aea5bdab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.377472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdf0df-919a-4ab4-8c73-a665aea5bdab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-decdf0df-919a-4ab4-8c73-a665aea5bdab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:28.383562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:28.384448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:28.385245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:28.387859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 133/259] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:28.394950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdf0df-919a-4ab4-8c73-a665aea5bdab None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.410804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95853-ea2d-4ac4-ab45-9352f33a8957 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.456898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf96627-77c5-4704-b161-be604bfe7612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.457500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf96627-77c5-4704-b161-be604bfe7612 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.457785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf96627-77c5-4704-b161-be604bfe7612 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.458117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf96627-77c5-4704-b161-be604bfe7612 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.458907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf96627-77c5-4704-b161-be604bfe7612 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:28.459216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf96627-77c5-4704-b161-be604bfe7612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:28.460688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf96627-77c5-4704-b161-be604bfe7612 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:28.473534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 127/260] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:28.483224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf96627-77c5-4704-b161-be604bfe7612 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.584262 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdf0df-919a-4ab4-8c73-a665aea5bdab None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.622544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:28.644905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:28.653754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55944f8-b74c-4386-9aa4-be11364ea5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.654419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55944f8-b74c-4386-9aa4-be11364ea5ed None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.654771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55944f8-b74c-4386-9aa4-be11364ea5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.655050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55944f8-b74c-4386-9aa4-be11364ea5ed None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.655726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55944f8-b74c-4386-9aa4-be11364ea5ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:28.656028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55944f8-b74c-4386-9aa4-be11364ea5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:28.659674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55944f8-b74c-4386-9aa4-be11364ea5ed None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:28.671729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 134/261] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:28.676954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55944f8-b74c-4386-9aa4-be11364ea5ed None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.687801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf96627-77c5-4704-b161-be604bfe7612 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.783530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67e5ae-a2bd-4346-9bc0-7e1f0e6f840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.784088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67e5ae-a2bd-4346-9bc0-7e1f0e6f840b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.784534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67e5ae-a2bd-4346-9bc0-7e1f0e6f840b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.784937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67e5ae-a2bd-4346-9bc0-7e1f0e6f840b None admin] PATH_INFO: `/v3/users/24d2f3b5109440a589d4c16e49ce03cc` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.790887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67e5ae-a2bd-4346-9bc0-7e1f0e6f840b None admin] RBAC: Authorizing `identity:get_user(user_id=24d2f3b5109440a589d4c16e49ce03cc)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:28.792534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67e5ae-a2bd-4346-9bc0-7e1f0e6f840b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:28.794656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 128/262] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/users/24d2f3b5109440a589d4c16e49ce03cc => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:28.800097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67e5ae-a2bd-4346-9bc0-7e1f0e6f840b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.853794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55944f8-b74c-4386-9aa4-be11364ea5ed None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.910315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d8628-91de-4aff-95f7-1e33b63a2f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.911191 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8628-91de-4aff-95f7-1e33b63a2f0d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.912235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8628-91de-4aff-95f7-1e33b63a2f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.912695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8628-91de-4aff-95f7-1e33b63a2f0d None admin] PATH_INFO: `/v3/users/24d2f3b5109440a589d4c16e49ce03cc` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.914581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d8628-91de-4aff-95f7-1e33b63a2f0d None admin] RBAC: Authorizing `identity:get_user(user_id=24d2f3b5109440a589d4c16e49ce03cc)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:28.916743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d8628-91de-4aff-95f7-1e33b63a2f0d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:28.918871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 135/263] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/users/24d2f3b5109440a589d4c16e49ce03cc => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:28.924002 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d8628-91de-4aff-95f7-1e33b63a2f0d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:29.013890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.044457 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67e5ae-a2bd-4346-9bc0-7e1f0e6f840b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d8628-91de-4aff-95f7-1e33b63a2f0d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.115723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca737f1-5739-4d2a-a636-e6a44aabe0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.117555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca737f1-5739-4d2a-a636-e6a44aabe0ff None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.118174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca737f1-5739-4d2a-a636-e6a44aabe0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.119772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca737f1-5739-4d2a-a636-e6a44aabe0ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.137851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.145800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255e1b-bd3f-42c1-9627-7408e127ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.146896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255e1b-bd3f-42c1-9627-7408e127ab28 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.147573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255e1b-bd3f-42c1-9627-7408e127ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.148015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255e1b-bd3f-42c1-9627-7408e127ab28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.238244 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca737f1-5739-4d2a-a636-e6a44aabe0ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.239744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca737f1-5739-4d2a-a636-e6a44aabe0ff None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.303486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c255e1b-bd3f-42c1-9627-7408e127ab28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.305462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c255e1b-bd3f-42c1-9627-7408e127ab28 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.348147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 129/264] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:26:29.355082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca737f1-5739-4d2a-a636-e6a44aabe0ff None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:29.451591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.452985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.546221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 136/265] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:26:29.551290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255e1b-bd3f-42c1-9627-7408e127ab28 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:29.588306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca737f1-5739-4d2a-a636-e6a44aabe0ff None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.674920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e3f8c-cb7f-4b41-9d27-7b227faf6e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.675579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e3f8c-cb7f-4b41-9d27-7b227faf6e33 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.675901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e3f8c-cb7f-4b41-9d27-7b227faf6e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.676149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e3f8c-cb7f-4b41-9d27-7b227faf6e33 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.677805 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e3f8c-cb7f-4b41-9d27-7b227faf6e33 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.679396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e3f8c-cb7f-4b41-9d27-7b227faf6e33 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.681353 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 130/266] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:29 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:29.687716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e3f8c-cb7f-4b41-9d27-7b227faf6e33 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:29.776827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255e1b-bd3f-42c1-9627-7408e127ab28 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.838628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87bd13-74bf-4c9d-9bab-00f58b048f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.839186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87bd13-74bf-4c9d-9bab-00f58b048f88 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.839470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87bd13-74bf-4c9d-9bab-00f58b048f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.839743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87bd13-74bf-4c9d-9bab-00f58b048f88 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.840949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87bd13-74bf-4c9d-9bab-00f58b048f88 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.842507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87bd13-74bf-4c9d-9bab-00f58b048f88 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.844995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 137/267] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:29 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:29.851873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87bd13-74bf-4c9d-9bab-00f58b048f88 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:29.910548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.930604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e3f8c-cb7f-4b41-9d27-7b227faf6e33 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.938874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.980909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1da5d-87a9-4e51-89ae-7dc1416bda45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.981527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1da5d-87a9-4e51-89ae-7dc1416bda45 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.981804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1da5d-87a9-4e51-89ae-7dc1416bda45 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.982077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1da5d-87a9-4e51-89ae-7dc1416bda45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.982876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1da5d-87a9-4e51-89ae-7dc1416bda45 None admin] RBAC: Adding query filter params (role.id=60c41aabe4694d07bf0b66f5223c3d0d, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54, user.id=24d2f3b5109440a589d4c16e49ce03cc) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:29.983223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1da5d-87a9-4e51-89ae-7dc1416bda45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.984831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1da5d-87a9-4e51-89ae-7dc1416bda45 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.991871 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 131/268] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:29 2022] GET /identity/v3/role_assignments?user.id=24d2f3b5109440a589d4c16e49ce03cc&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=60c41aabe4694d07bf0b66f5223c3d0d => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:29.993619 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521d238-e3c2-4f3f-951b-0262c94903ee None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.993906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521d238-e3c2-4f3f-951b-0262c94903ee None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.994186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521d238-e3c2-4f3f-951b-0262c94903ee None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.995676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 132/269] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:30.001363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a04ed-9ffc-4f8e-b8eb-90d8a1263574 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.001698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a04ed-9ffc-4f8e-b8eb-90d8a1263574 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.001910 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a04ed-9ffc-4f8e-b8eb-90d8a1263574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.034573 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6f2a04ed-9ffc-4f8e-b8eb-90d8a1263574 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:30.035806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6f2a04ed-9ffc-4f8e-b8eb-90d8a1263574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:30.060952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87bd13-74bf-4c9d-9bab-00f58b048f88 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:30.118675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6b2d7-f093-4f90-b7e2-f53faa5550f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:30.119267 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6b2d7-f093-4f90-b7e2-f53faa5550f9 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.119555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6b2d7-f093-4f90-b7e2-f53faa5550f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.119823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6b2d7-f093-4f90-b7e2-f53faa5550f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.120561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6b2d7-f093-4f90-b7e2-f53faa5550f9 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54, user.id=24d2f3b5109440a589d4c16e49ce03cc) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:30.120870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6b2d7-f093-4f90-b7e2-f53faa5550f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:30.122346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6b2d7-f093-4f90-b7e2-f53faa5550f9 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:30.135062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 133/270] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:30.137207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 138/271] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:29 2022] GET /identity/v3/role_assignments?user.id=24d2f3b5109440a589d4c16e49ce03cc&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:30.446031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eeea1-693d-4dd5-9f0a-8ebb8804c1ed None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.446248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eeea1-693d-4dd5-9f0a-8ebb8804c1ed None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.446536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eeea1-693d-4dd5-9f0a-8ebb8804c1ed None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.448050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 134/272] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:30.453687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbe87d-bf87-4352-b126-b838e47ae028 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.453976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbe87d-bf87-4352-b126-b838e47ae028 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.454306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbe87d-bf87-4352-b126-b838e47ae028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.470499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eeea1-693d-4dd5-9f0a-8ebb8804c1ed None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:30.475429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-51cbe87d-bf87-4352-b126-b838e47ae028 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:30.476853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-51cbe87d-bf87-4352-b126-b838e47ae028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:30.561390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 139/273] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:30.563020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae418a-a7c2-4163-a3e8-499b2bf37e14 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.563503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae418a-a7c2-4163-a3e8-499b2bf37e14 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.563969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae418a-a7c2-4163-a3e8-499b2bf37e14 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.565922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 140/274] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:30.567387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d17e-9d66-4a52-bcc7-732b9ef08344 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.567878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d17e-9d66-4a52-bcc7-732b9ef08344 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.568220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d17e-9d66-4a52-bcc7-732b9ef08344 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.569500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 141/275] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:30.573769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2ac6-f202-4f33-8209-ce13bdebb66d None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.574050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2ac6-f202-4f33-8209-ce13bdebb66d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.574421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2ac6-f202-4f33-8209-ce13bdebb66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.599376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-4fef2ac6-f202-4f33-8209-ce13bdebb66d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:30.600642 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-4fef2ac6-f202-4f33-8209-ce13bdebb66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:30.618617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:30.622634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:30.624913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eeea1-693d-4dd5-9f0a-8ebb8804c1ed None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:30.662506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fe9e2-3e7a-44eb-b5a4-2721d51c119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:30.663135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fe9e2-3e7a-44eb-b5a4-2721d51c119d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.663414 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fe9e2-3e7a-44eb-b5a4-2721d51c119d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.663681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fe9e2-3e7a-44eb-b5a4-2721d51c119d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.674669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fe9e2-3e7a-44eb-b5a4-2721d51c119d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-501fe9e2-3e7a-44eb-b5a4-2721d51c119d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:30.680202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:30.681100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:30.681990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 135/276] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:30.682705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0cdae-0ae4-4c69-89f4-ca049a75cbcc None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.682781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0cdae-0ae4-4c69-89f4-ca049a75cbcc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.683353 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0cdae-0ae4-4c69-89f4-ca049a75cbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.694307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 142/277] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:30.694307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef2ac6-f202-4f33-8209-ce13bdebb66d None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:30.710639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-31d0cdae-0ae4-4c69-89f4-ca049a75cbcc None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:30.712415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-31d0cdae-0ae4-4c69-89f4-ca049a75cbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:30.802704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef2ac6-f202-4f33-8209-ce13bdebb66d None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:30.805992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 136/278] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:30.840092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c52949-54ae-428f-8bcb-f36002da7fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:30.840705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c52949-54ae-428f-8bcb-f36002da7fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.840982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c52949-54ae-428f-8bcb-f36002da7fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.841313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c52949-54ae-428f-8bcb-f36002da7fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.841987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c52949-54ae-428f-8bcb-f36002da7fb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:30.842391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c52949-54ae-428f-8bcb-f36002da7fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:30.843780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c52949-54ae-428f-8bcb-f36002da7fb1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:30.853184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0cdae-0ae4-4c69-89f4-ca049a75cbcc None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:30.857216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 143/279] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:30.859603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c52949-54ae-428f-8bcb-f36002da7fb1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:30.883723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:30.961154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:30.971343 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0cdae-0ae4-4c69-89f4-ca049a75cbcc None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:30.990449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c52949-54ae-428f-8bcb-f36002da7fb1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.007389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961794f-1a36-4668-9ee2-3da4fadd404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.008024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961794f-1a36-4668-9ee2-3da4fadd404f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.008315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961794f-1a36-4668-9ee2-3da4fadd404f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.008586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961794f-1a36-4668-9ee2-3da4fadd404f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.009682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961794f-1a36-4668-9ee2-3da4fadd404f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.011178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961794f-1a36-4668-9ee2-3da4fadd404f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.012744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 137/280] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:31.014358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961794f-1a36-4668-9ee2-3da4fadd404f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.029563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c615e-a08c-4485-8c3e-f36195964e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.030219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c615e-a08c-4485-8c3e-f36195964e8a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.030662 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c615e-a08c-4485-8c3e-f36195964e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.030939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c615e-a08c-4485-8c3e-f36195964e8a None admin] PATH_INFO: `/v3/users/0a93958dc36d405ca08e9b4f3abac845` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.044956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c615e-a08c-4485-8c3e-f36195964e8a None admin] RBAC: Authorizing `identity:get_user(user_id=0a93958dc36d405ca08e9b4f3abac845)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.046451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c615e-a08c-4485-8c3e-f36195964e8a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.048096 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 144/281] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:30 2022] GET /identity/v3/users/0a93958dc36d405ca08e9b4f3abac845 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:31.048989 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c615e-a08c-4485-8c3e-f36195964e8a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.122881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961794f-1a36-4668-9ee2-3da4fadd404f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.124246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:31.148251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c615e-a08c-4485-8c3e-f36195964e8a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.157868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b89a8-211f-4e8e-a3f7-6e848b9fc267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.158525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b89a8-211f-4e8e-a3f7-6e848b9fc267 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.158812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b89a8-211f-4e8e-a3f7-6e848b9fc267 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.159083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b89a8-211f-4e8e-a3f7-6e848b9fc267 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.170683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b89a8-211f-4e8e-a3f7-6e848b9fc267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-132b89a8-211f-4e8e-a3f7-6e848b9fc267 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:31.175384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:31.176452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 138/282] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:31.177331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b89a8-211f-4e8e-a3f7-6e848b9fc267 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.186617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b949-bca0-40f6-afe6-73244e424422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.187274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b949-bca0-40f6-afe6-73244e424422 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.187554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b949-bca0-40f6-afe6-73244e424422 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.187823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b949-bca0-40f6-afe6-73244e424422 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.188469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b949-bca0-40f6-afe6-73244e424422 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.189896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b949-bca0-40f6-afe6-73244e424422 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.198476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:31.277521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b89a8-211f-4e8e-a3f7-6e848b9fc267 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.288600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 145/283] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:31 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:31.289584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b949-bca0-40f6-afe6-73244e424422 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.314737 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e44a5-17ed-47fb-aa65-8178e1261872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.315621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e44a5-17ed-47fb-aa65-8178e1261872 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.315913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e44a5-17ed-47fb-aa65-8178e1261872 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.316269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e44a5-17ed-47fb-aa65-8178e1261872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.316944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e44a5-17ed-47fb-aa65-8178e1261872 None admin] RBAC: Adding query filter params (role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, user.id=0a93958dc36d405ca08e9b4f3abac845, scope.system=all) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:31.317683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e44a5-17ed-47fb-aa65-8178e1261872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.320454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e44a5-17ed-47fb-aa65-8178e1261872 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.326866 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 139/284] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/role_assignments?user.id=0a93958dc36d405ca08e9b4f3abac845&scope.system=all&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:31.327761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e44a5-17ed-47fb-aa65-8178e1261872 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.436343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b949-bca0-40f6-afe6-73244e424422 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.442624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:31.478288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e44a5-17ed-47fb-aa65-8178e1261872 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.484236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:31.493163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51995a9-7555-452e-811e-e55f6eaf7814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.494083 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51995a9-7555-452e-811e-e55f6eaf7814 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.494537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51995a9-7555-452e-811e-e55f6eaf7814 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.494957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51995a9-7555-452e-811e-e55f6eaf7814 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.508639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51995a9-7555-452e-811e-e55f6eaf7814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-c51995a9-7555-452e-811e-e55f6eaf7814 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:31.513397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:31.514403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:31.515220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:31.515832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 146/285] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:31.521601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51995a9-7555-452e-811e-e55f6eaf7814 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.526878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc22492-0125-41de-8856-6828ced620b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.527515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc22492-0125-41de-8856-6828ced620b5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.527852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc22492-0125-41de-8856-6828ced620b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.528085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc22492-0125-41de-8856-6828ced620b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.528765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc22492-0125-41de-8856-6828ced620b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:31.529073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc22492-0125-41de-8856-6828ced620b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.530745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc22492-0125-41de-8856-6828ced620b5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.543314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 140/286] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:31.551188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc22492-0125-41de-8856-6828ced620b5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.668480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51995a9-7555-452e-811e-e55f6eaf7814 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.681269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc22492-0125-41de-8856-6828ced620b5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.716307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d1ce-37c0-43c5-b4a7-b0bfa3e81d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.717284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d1ce-37c0-43c5-b4a7-b0bfa3e81d1c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.717761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d1ce-37c0-43c5-b4a7-b0bfa3e81d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.718231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d1ce-37c0-43c5-b4a7-b0bfa3e81d1c None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.719101 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004d1ce-37c0-43c5-b4a7-b0bfa3e81d1c None admin] RBAC: Adding query filter params (name=member) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:31.719578 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004d1ce-37c0-43c5-b4a7-b0bfa3e81d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.721184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004d1ce-37c0-43c5-b4a7-b0bfa3e81d1c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.723116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49173f2-e61c-43b1-b52f-c41f28c3587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.723854 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49173f2-e61c-43b1-b52f-c41f28c3587c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.724248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49173f2-e61c-43b1-b52f-c41f28c3587c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.724597 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49173f2-e61c-43b1-b52f-c41f28c3587c None admin] PATH_INFO: `/v3/users/4b15621db9a747f3a6d56e892f14cc2c` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.725834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49173f2-e61c-43b1-b52f-c41f28c3587c None admin] RBAC: Authorizing `identity:get_user(user_id=4b15621db9a747f3a6d56e892f14cc2c)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.727423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49173f2-e61c-43b1-b52f-c41f28c3587c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.729375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 141/287] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/users/4b15621db9a747f3a6d56e892f14cc2c => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:31.731933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 147/288] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:31.734673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49173f2-e61c-43b1-b52f-c41f28c3587c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.743350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d1ce-37c0-43c5-b4a7-b0bfa3e81d1c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.759997 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:31.838581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:31.899459 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49173f2-e61c-43b1-b52f-c41f28c3587c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.902766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d1ce-37c0-43c5-b4a7-b0bfa3e81d1c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.934469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82a3d8-712b-4fc0-af35-67a707a3bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.935116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82a3d8-712b-4fc0-af35-67a707a3bfab None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.935401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82a3d8-712b-4fc0-af35-67a707a3bfab None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.935681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82a3d8-712b-4fc0-af35-67a707a3bfab None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.936807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82a3d8-712b-4fc0-af35-67a707a3bfab None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.938618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82a3d8-712b-4fc0-af35-67a707a3bfab None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.945864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 142/289] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:31.946481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6f91b-23fe-450e-bb4e-d0285105eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.947317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6f91b-23fe-450e-bb4e-d0285105eb58 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.947727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6f91b-23fe-450e-bb4e-d0285105eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.948126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6f91b-23fe-450e-bb4e-d0285105eb58 None admin] PATH_INFO: `/v3/users/1ecddeac45ca4c3dabb32d40878e52ba` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.951053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6f91b-23fe-450e-bb4e-d0285105eb58 None admin] RBAC: Authorizing `identity:get_user(user_id=1ecddeac45ca4c3dabb32d40878e52ba)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.952661 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6f91b-23fe-450e-bb4e-d0285105eb58 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.953278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82a3d8-712b-4fc0-af35-67a707a3bfab None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.954986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 148/290] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/users/1ecddeac45ca4c3dabb32d40878e52ba => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:31.962878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6f91b-23fe-450e-bb4e-d0285105eb58 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:32.087040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:32.124122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82a3d8-712b-4fc0-af35-67a707a3bfab None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:32.156993 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6f91b-23fe-450e-bb4e-d0285105eb58 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:32.196276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae9d2e-bfc1-46f3-a06f-b75d87637eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:32.199738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae9d2e-bfc1-46f3-a06f-b75d87637eac None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:32.200225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae9d2e-bfc1-46f3-a06f-b75d87637eac None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:32.200715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae9d2e-bfc1-46f3-a06f-b75d87637eac None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/users/4b15621db9a747f3a6d56e892f14cc2c/roles/7bf20f00c3594a4ab1e58f1b118fc3e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:32.201988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:32.204774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae9d2e-bfc1-46f3-a06f-b75d87637eac None admin] RBAC: Authorizing `identity:create_grant(project_id=73350d92b0dd475bbfeeb9bf45131a54, user_id=4b15621db9a747f3a6d56e892f14cc2c, role_id=7bf20f00c3594a4ab1e58f1b118fc3e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:32.207795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae9d2e-bfc1-46f3-a06f-b75d87637eac None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:32.222470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afea92-f63e-4b21-b41d-67a68e7782eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:32.223375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afea92-f63e-4b21-b41d-67a68e7782eb None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:32.223878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afea92-f63e-4b21-b41d-67a68e7782eb None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:32.224890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afea92-f63e-4b21-b41d-67a68e7782eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:32.300035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 143/291] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:31 2022] PUT /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/users/4b15621db9a747f3a6d56e892f14cc2c/roles/7bf20f00c3594a4ab1e58f1b118fc3e8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:32.310201 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afea92-f63e-4b21-b41d-67a68e7782eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:32.312074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afea92-f63e-4b21-b41d-67a68e7782eb None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:32.479038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 149/292] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:26:32.484696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae9d2e-bfc1-46f3-a06f-b75d87637eac None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:32.612185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae9d2e-bfc1-46f3-a06f-b75d87637eac None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:32.649600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4887e-5385-4ecf-b5c2-dfd4555807ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:32.650277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4887e-5385-4ecf-b5c2-dfd4555807ab None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:32.650565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4887e-5385-4ecf-b5c2-dfd4555807ab None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:32.650843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4887e-5385-4ecf-b5c2-dfd4555807ab None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:32.651983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4887e-5385-4ecf-b5c2-dfd4555807ab None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:32.653639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4887e-5385-4ecf-b5c2-dfd4555807ab None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:32.655610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 144/293] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:32 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:32.661137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afea92-f63e-4b21-b41d-67a68e7782eb None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:32.684796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:32.770818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afea92-f63e-4b21-b41d-67a68e7782eb None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:32.806607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3329daa-19ac-4c35-a1a0-db12bd37a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:32.807220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3329daa-19ac-4c35-a1a0-db12bd37a51b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:32.807501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3329daa-19ac-4c35-a1a0-db12bd37a51b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:32.807777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3329daa-19ac-4c35-a1a0-db12bd37a51b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:32.808507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3329daa-19ac-4c35-a1a0-db12bd37a51b None admin] RBAC: Adding query filter params (role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54, user.id=1ecddeac45ca4c3dabb32d40878e52ba) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:32.808817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3329daa-19ac-4c35-a1a0-db12bd37a51b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:32.810272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3329daa-19ac-4c35-a1a0-db12bd37a51b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:32.816950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 150/294] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:32 2022] GET /identity/v3/role_assignments?user.id=1ecddeac45ca4c3dabb32d40878e52ba&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:33.496935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2532d-3d14-4c9c-8322-db6aa2074ecf None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.497934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2532d-3d14-4c9c-8322-db6aa2074ecf None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.498523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2532d-3d14-4c9c-8322-db6aa2074ecf None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.511825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 145/295] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:33.511959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e8982-3b2d-4548-8517-772126f9ee8b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.511959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e8982-3b2d-4548-8517-772126f9ee8b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.511959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e8982-3b2d-4548-8517-772126f9ee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.526326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-b55e8982-3b2d-4548-8517-772126f9ee8b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:33.527846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b55e8982-3b2d-4548-8517-772126f9ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:33.605023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 151/296] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:33.723190 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8dfcd-1ef4-427f-a245-08e4cef5eb40 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.723504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8dfcd-1ef4-427f-a245-08e4cef5eb40 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.723746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8dfcd-1ef4-427f-a245-08e4cef5eb40 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.725905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 146/297] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:33.731209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67015-78ee-434b-b29f-2e19ef02dbee None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.731498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67015-78ee-434b-b29f-2e19ef02dbee None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.731775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67015-78ee-434b-b29f-2e19ef02dbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.749731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-efb67015-78ee-434b-b29f-2e19ef02dbee None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:33.750866 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-efb67015-78ee-434b-b29f-2e19ef02dbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:33.761464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:33.769367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecca3b-9778-4c74-b151-e527d5419a2d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.769557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecca3b-9778-4c74-b151-e527d5419a2d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.769933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecca3b-9778-4c74-b151-e527d5419a2d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.777242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 147/298] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:33.777388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385701aa-4a7a-4428-b23b-afd4c6596728 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.777753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385701aa-4a7a-4428-b23b-afd4c6596728 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.777875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385701aa-4a7a-4428-b23b-afd4c6596728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.796177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-385701aa-4a7a-4428-b23b-afd4c6596728 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:33.797360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-385701aa-4a7a-4428-b23b-afd4c6596728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:33.799422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:33.834120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 152/299] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:33.877036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 148/300] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:33.902803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb67015-78ee-434b-b29f-2e19ef02dbee None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.006251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb67015-78ee-434b-b29f-2e19ef02dbee None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.041347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc635-37e0-4d78-ac24-2ceedd30b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.042313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc635-37e0-4d78-ac24-2ceedd30b902 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.042767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc635-37e0-4d78-ac24-2ceedd30b902 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.043212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc635-37e0-4d78-ac24-2ceedd30b902 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.057766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc635-37e0-4d78-ac24-2ceedd30b902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-352fc635-37e0-4d78-ac24-2ceedd30b902 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:34.062709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:34.063626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:34.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:34.066654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 153/301] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:34.072917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385701aa-4a7a-4428-b23b-afd4c6596728 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.144031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc635-37e0-4d78-ac24-2ceedd30b902 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.150503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.183535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385701aa-4a7a-4428-b23b-afd4c6596728 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.223147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020073-d29c-41d5-a501-df46c655b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.223763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020073-d29c-41d5-a501-df46c655b937 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.224783 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020073-d29c-41d5-a501-df46c655b937 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.225161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020073-d29c-41d5-a501-df46c655b937 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.225732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8020073-d29c-41d5-a501-df46c655b937 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:34.226224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8020073-d29c-41d5-a501-df46c655b937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.227445 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8020073-d29c-41d5-a501-df46c655b937 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.233103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.238661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 149/302] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:34.238661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020073-d29c-41d5-a501-df46c655b937 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.264789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc635-37e0-4d78-ac24-2ceedd30b902 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.300293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f93f2-296a-4685-ad39-a8e940574e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.301197 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f93f2-296a-4685-ad39-a8e940574e0f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.301701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f93f2-296a-4685-ad39-a8e940574e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.302687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f93f2-296a-4685-ad39-a8e940574e0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.314925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f93f2-296a-4685-ad39-a8e940574e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-788f93f2-296a-4685-ad39-a8e940574e0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:34.320730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:34.321687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:34.322558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 154/303] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:34.327024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f93f2-296a-4685-ad39-a8e940574e0f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.347544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020073-d29c-41d5-a501-df46c655b937 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.383636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74202412-39e4-4d9e-9b23-65b0737d5c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.384271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74202412-39e4-4d9e-9b23-65b0737d5c0a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.384544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74202412-39e4-4d9e-9b23-65b0737d5c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.384816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74202412-39e4-4d9e-9b23-65b0737d5c0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.385943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74202412-39e4-4d9e-9b23-65b0737d5c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.387443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74202412-39e4-4d9e-9b23-65b0737d5c0a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.390306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 150/304] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:34.390306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74202412-39e4-4d9e-9b23-65b0737d5c0a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.403299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.443509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f93f2-296a-4685-ad39-a8e940574e0f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.465893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.482035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9e110-ca76-4cc9-8ad4-3fa0aa28778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.482701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e110-ca76-4cc9-8ad4-3fa0aa28778a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.482985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e110-ca76-4cc9-8ad4-3fa0aa28778a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.483262 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e110-ca76-4cc9-8ad4-3fa0aa28778a None admin] PATH_INFO: `/v3/users/0a93958dc36d405ca08e9b4f3abac845` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.484404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9e110-ca76-4cc9-8ad4-3fa0aa28778a None admin] RBAC: Authorizing `identity:get_user(user_id=0a93958dc36d405ca08e9b4f3abac845)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.485842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9e110-ca76-4cc9-8ad4-3fa0aa28778a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.487446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 155/305] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/users/0a93958dc36d405ca08e9b4f3abac845 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:34.493430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9e110-ca76-4cc9-8ad4-3fa0aa28778a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.504879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74202412-39e4-4d9e-9b23-65b0737d5c0a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.542636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b8ae-ad47-4d04-8b04-4237386be0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.543688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b8ae-ad47-4d04-8b04-4237386be0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.544147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b8ae-ad47-4d04-8b04-4237386be0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.544631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b8ae-ad47-4d04-8b04-4237386be0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.545453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b8ae-ad47-4d04-8b04-4237386be0f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:34.545908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b8ae-ad47-4d04-8b04-4237386be0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.547630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b8ae-ad47-4d04-8b04-4237386be0f4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.562053 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 151/306] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:34.563302 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b8ae-ad47-4d04-8b04-4237386be0f4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.600501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9e110-ca76-4cc9-8ad4-3fa0aa28778a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.630704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.635602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce79130-f61f-4bcd-9723-bffa1bbfe6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.636223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce79130-f61f-4bcd-9723-bffa1bbfe6e1 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.636511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce79130-f61f-4bcd-9723-bffa1bbfe6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.636784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce79130-f61f-4bcd-9723-bffa1bbfe6e1 None admin] PATH_INFO: `/v3/groups` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.637407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce79130-f61f-4bcd-9723-bffa1bbfe6e1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.638914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce79130-f61f-4bcd-9723-bffa1bbfe6e1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.667551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b8ae-ad47-4d04-8b04-4237386be0f4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.695516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.700902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5747-cde3-494a-9486-61f00da64a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.701533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5747-cde3-494a-9486-61f00da64a30 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.701815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5747-cde3-494a-9486-61f00da64a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.702091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5747-cde3-494a-9486-61f00da64a30 None admin] PATH_INFO: `/v3/system/users/0a93958dc36d405ca08e9b4f3abac845/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.703496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5747-cde3-494a-9486-61f00da64a30 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0a93958dc36d405ca08e9b4f3abac845, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.704875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5747-cde3-494a-9486-61f00da64a30 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.720170 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 156/307] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Aug 22 12:26:34 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:34.721015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce79130-f61f-4bcd-9723-bffa1bbfe6e1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.789815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 152/308] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Aug 22 12:26:34 2022] PUT /identity/v3/system/users/0a93958dc36d405ca08e9b4f3abac845/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:34.800380 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfeb4e-f690-4d4d-be20-aa04f300b513 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.800873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfeb4e-f690-4d4d-be20-aa04f300b513 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.802564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfeb4e-f690-4d4d-be20-aa04f300b513 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.804401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 153/309] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:34.811579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd43e-5ac0-47f2-bfbc-478e4243bc35 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.812047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd43e-5ac0-47f2-bfbc-478e4243bc35 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.812425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd43e-5ac0-47f2-bfbc-478e4243bc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.840145 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-df0fd43e-5ac0-47f2-bfbc-478e4243bc35 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:34.842514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-df0fd43e-5ac0-47f2-bfbc-478e4243bc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:34.845445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce79130-f61f-4bcd-9723-bffa1bbfe6e1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.890125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9c72c-e05a-4d86-9966-c889e68ccf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.891269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9c72c-e05a-4d86-9966-c889e68ccf91 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.892609 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9c72c-e05a-4d86-9966-c889e68ccf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.892895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9c72c-e05a-4d86-9966-c889e68ccf91 None admin] PATH_INFO: `/v3/users/e69e4dd700a546be8503ce5bc558ff5b` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.912364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9c72c-e05a-4d86-9966-c889e68ccf91 None admin] RBAC: Authorizing `identity:get_user(user_id=e69e4dd700a546be8503ce5bc558ff5b)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.913869 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9c72c-e05a-4d86-9966-c889e68ccf91 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.917155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 157/310] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/users/e69e4dd700a546be8503ce5bc558ff5b => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:34.923165 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9c72c-e05a-4d86-9966-c889e68ccf91 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.937506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 154/311] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:34.979118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:35.030476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9c72c-e05a-4d86-9966-c889e68ccf91 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:35.066871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c77b4c-d898-4004-b022-3a7e08ed8ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:35.067397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c77b4c-d898-4004-b022-3a7e08ed8ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:35.067827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c77b4c-d898-4004-b022-3a7e08ed8ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:35.068151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c77b4c-d898-4004-b022-3a7e08ed8ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:35.068937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c77b4c-d898-4004-b022-3a7e08ed8ee8 None admin] RBAC: Adding query filter params (role.id=7bf20f00c3594a4ab1e58f1b118fc3e8, user.id=e69e4dd700a546be8503ce5bc558ff5b, scope.system=all) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:35.069245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c77b4c-d898-4004-b022-3a7e08ed8ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:35.070807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c77b4c-d898-4004-b022-3a7e08ed8ee8 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:35.076315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 158/312] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/role_assignments?user.id=e69e4dd700a546be8503ce5bc558ff5b&scope.system=all&role.id=7bf20f00c3594a4ab1e58f1b118fc3e8 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:35.231579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fd43e-5ac0-47f2-bfbc-478e4243bc35 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:35.344740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fd43e-5ac0-47f2-bfbc-478e4243bc35 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:35.370385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:35.381995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d25d1-2752-4883-91ac-8eda666e8da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:35.388958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d25d1-2752-4883-91ac-8eda666e8da1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:35.388958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d25d1-2752-4883-91ac-8eda666e8da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:35.388958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d25d1-2752-4883-91ac-8eda666e8da1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:35.393743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d25d1-2752-4883-91ac-8eda666e8da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-784d25d1-2752-4883-91ac-8eda666e8da1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:35.398942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:35.399842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:35.400644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 155/313] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:35.411293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c77b4c-d898-4004-b022-3a7e08ed8ee8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:35.519809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c77b4c-d898-4004-b022-3a7e08ed8ee8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:35.535646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:35.556556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9be44-2018-46d2-b836-174a889175a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:35.557166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9be44-2018-46d2-b836-174a889175a3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:35.557449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9be44-2018-46d2-b836-174a889175a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:35.557726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9be44-2018-46d2-b836-174a889175a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:35.558430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9be44-2018-46d2-b836-174a889175a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:35.558737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9be44-2018-46d2-b836-174a889175a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:35.560261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9be44-2018-46d2-b836-174a889175a3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:35.568949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 159/314] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:35.574552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d25d1-2752-4883-91ac-8eda666e8da1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:35.682721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d25d1-2752-4883-91ac-8eda666e8da1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:35.718721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ba62-dd07-42d2-9961-06024b7c6053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:35.719359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ba62-dd07-42d2-9961-06024b7c6053 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:35.719639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ba62-dd07-42d2-9961-06024b7c6053 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:35.719970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ba62-dd07-42d2-9961-06024b7c6053 None admin] PATH_INFO: `/v3/users/4b15621db9a747f3a6d56e892f14cc2c` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:35.721116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398ba62-dd07-42d2-9961-06024b7c6053 None admin] RBAC: Authorizing `identity:get_user(user_id=4b15621db9a747f3a6d56e892f14cc2c)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:35.722614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398ba62-dd07-42d2-9961-06024b7c6053 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:35.724287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 156/315] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:35 2022] GET /identity/v3/users/4b15621db9a747f3a6d56e892f14cc2c => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:35.730429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9be44-2018-46d2-b836-174a889175a3 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:35.832418 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9be44-2018-46d2-b836-174a889175a3 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:35.871372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3833b3-259c-462f-bd75-84fa53129606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:35.872327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3833b3-259c-462f-bd75-84fa53129606 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:35.872815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3833b3-259c-462f-bd75-84fa53129606 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:35.873323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3833b3-259c-462f-bd75-84fa53129606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:35.920548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:35.946914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3833b3-259c-462f-bd75-84fa53129606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:35.948677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3833b3-259c-462f-bd75-84fa53129606 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:36.053856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 160/316] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:36.059225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ba62-dd07-42d2-9961-06024b7c6053 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:36.114823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:36.164186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ba62-dd07-42d2-9961-06024b7c6053 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:36.202453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2db8ea-d384-43d7-9002-974d0ce538b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:36.203022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2db8ea-d384-43d7-9002-974d0ce538b8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:36.203305 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2db8ea-d384-43d7-9002-974d0ce538b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:36.203578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2db8ea-d384-43d7-9002-974d0ce538b8 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:36.204710 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2db8ea-d384-43d7-9002-974d0ce538b8 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:36.206172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2db8ea-d384-43d7-9002-974d0ce538b8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:36.208120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 157/317] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:36 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:36.214267 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3833b3-259c-462f-bd75-84fa53129606 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:36.292609 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:36.322296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3833b3-259c-462f-bd75-84fa53129606 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:36.364666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f9a64-045e-4c04-a280-a6f4c3555732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:36.365389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9a64-045e-4c04-a280-a6f4c3555732 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:36.365677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9a64-045e-4c04-a280-a6f4c3555732 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:36.365958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9a64-045e-4c04-a280-a6f4c3555732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:36.366735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f9a64-045e-4c04-a280-a6f4c3555732 None admin] RBAC: Adding query filter params (role.id=7bf20f00c3594a4ab1e58f1b118fc3e8, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54, user.id=4b15621db9a747f3a6d56e892f14cc2c) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:36.367053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f9a64-045e-4c04-a280-a6f4c3555732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:36.369208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f9a64-045e-4c04-a280-a6f4c3555732 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:36.376514 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 161/318] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:36 2022] GET /identity/v3/role_assignments?user.id=4b15621db9a747f3a6d56e892f14cc2c&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=7bf20f00c3594a4ab1e58f1b118fc3e8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:36.825150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5612-b8c1-466c-ba2b-3319c8335c25 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:36.825658 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5612-b8c1-466c-ba2b-3319c8335c25 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:36.825733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5612-b8c1-466c-ba2b-3319c8335c25 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:36.827048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 158/319] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:36.832135 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e2e88-65d6-46be-88fc-e7d83db9773c None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:36.832685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e2e88-65d6-46be-88fc-e7d83db9773c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:36.832685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e2e88-65d6-46be-88fc-e7d83db9773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:36.852215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-de2e2e88-65d6-46be-88fc-e7d83db9773c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:36.853400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-de2e2e88-65d6-46be-88fc-e7d83db9773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:36.903050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c9862-7f2f-4bf7-bbc6-d2bc3d344d4f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:36.903694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c9862-7f2f-4bf7-bbc6-d2bc3d344d4f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:36.904060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c9862-7f2f-4bf7-bbc6-d2bc3d344d4f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:36.905587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 159/320] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:36.910428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41886f1-aa09-4c7a-83ab-51c0e2eaafec None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:36.910712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41886f1-aa09-4c7a-83ab-51c0e2eaafec None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:36.910987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41886f1-aa09-4c7a-83ab-51c0e2eaafec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:36.924730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 162/321] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:36.930733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c41886f1-aa09-4c7a-83ab-51c0e2eaafec None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:36.932071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c41886f1-aa09-4c7a-83ab-51c0e2eaafec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:36.998734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 160/322] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:37.052538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafc57-a7d8-4fb0-9930-14a6e7ef54c1 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.052968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafc57-a7d8-4fb0-9930-14a6e7ef54c1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.053266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafc57-a7d8-4fb0-9930-14a6e7ef54c1 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.054719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 163/323] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:37.059865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f677d3-3e33-431a-849f-1c7f14ce2ef7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.060235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f677d3-3e33-431a-849f-1c7f14ce2ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.060584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f677d3-3e33-431a-849f-1c7f14ce2ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.078966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d6f677d3-3e33-431a-849f-1c7f14ce2ef7 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:37.080164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d6f677d3-3e33-431a-849f-1c7f14ce2ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:37.128079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:37.148703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 161/324] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:37.201033 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aafc57-a7d8-4fb0-9930-14a6e7ef54c1 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.267009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f677d3-3e33-431a-849f-1c7f14ce2ef7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.275967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:37.309144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aafc57-a7d8-4fb0-9930-14a6e7ef54c1 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.344934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27a837-2f03-4fd4-ab1a-682eb75a0e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.345475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a837-2f03-4fd4-ab1a-682eb75a0e5e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.345752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a837-2f03-4fd4-ab1a-682eb75a0e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.346021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a837-2f03-4fd4-ab1a-682eb75a0e5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.347148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27a837-2f03-4fd4-ab1a-682eb75a0e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:37.348591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27a837-2f03-4fd4-ab1a-682eb75a0e5e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:37.351304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 164/325] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:37.356601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27a837-2f03-4fd4-ab1a-682eb75a0e5e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.375041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f677d3-3e33-431a-849f-1c7f14ce2ef7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.410681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c0d00-06f4-4799-a4c7-fe5cd87009d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.412082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c0d00-06f4-4799-a4c7-fe5cd87009d4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.412505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c0d00-06f4-4799-a4c7-fe5cd87009d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.412920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c0d00-06f4-4799-a4c7-fe5cd87009d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.423139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c0d00-06f4-4799-a4c7-fe5cd87009d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6b2c0d00-06f4-4799-a4c7-fe5cd87009d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:37.428427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:37.429332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:37.430161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 162/326] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:37.430878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c0d00-06f4-4799-a4c7-fe5cd87009d4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.459387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27a837-2f03-4fd4-ab1a-682eb75a0e5e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.471179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:37.493372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da9c21-dbab-4be2-89e7-d373f6b5df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.493969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da9c21-dbab-4be2-89e7-d373f6b5df40 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.494271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da9c21-dbab-4be2-89e7-d373f6b5df40 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.494543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da9c21-dbab-4be2-89e7-d373f6b5df40 None admin] PATH_INFO: `/v3/groups` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.495159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da9c21-dbab-4be2-89e7-d373f6b5df40 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:37.496586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da9c21-dbab-4be2-89e7-d373f6b5df40 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:37.528824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c0d00-06f4-4799-a4c7-fe5cd87009d4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.563245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6dea-c265-4861-a237-017e01bd5a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.563887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6dea-c265-4861-a237-017e01bd5a94 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.564153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6dea-c265-4861-a237-017e01bd5a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.564429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6dea-c265-4861-a237-017e01bd5a94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.574889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6dea-c265-4861-a237-017e01bd5a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b91b6dea-c265-4861-a237-017e01bd5a94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:37.579659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:37.580748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 163/327] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:37.583271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6dea-c265-4861-a237-017e01bd5a94 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.586874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:37.591892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 165/328] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Aug 22 12:26:37 2022] POST /identity/v3/groups => generated 226 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:26:37.592700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da9c21-dbab-4be2-89e7-d373f6b5df40 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.701141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:37.704233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6dea-c265-4861-a237-017e01bd5a94 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.705982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da9c21-dbab-4be2-89e7-d373f6b5df40 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.743488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63742c-04d7-40cf-8b63-d0f52ebc1d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.744142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63742c-04d7-40cf-8b63-d0f52ebc1d02 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.744395 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63742c-04d7-40cf-8b63-d0f52ebc1d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.744673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63742c-04d7-40cf-8b63-d0f52ebc1d02 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.745345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63742c-04d7-40cf-8b63-d0f52ebc1d02 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:37.745649 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63742c-04d7-40cf-8b63-d0f52ebc1d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:37.747144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63742c-04d7-40cf-8b63-d0f52ebc1d02 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:37.751403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf78a56-0075-41e7-86d3-e29713457ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.752027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf78a56-0075-41e7-86d3-e29713457ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.752307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf78a56-0075-41e7-86d3-e29713457ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.752580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf78a56-0075-41e7-86d3-e29713457ac4 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.753373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf78a56-0075-41e7-86d3-e29713457ac4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:37.753547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf78a56-0075-41e7-86d3-e29713457ac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:37.755128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf78a56-0075-41e7-86d3-e29713457ac4 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:37.758420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 164/329] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:37.764055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63742c-04d7-40cf-8b63-d0f52ebc1d02 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.768810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 166/330] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:37.770129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf78a56-0075-41e7-86d3-e29713457ac4 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.845389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:37.888978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63742c-04d7-40cf-8b63-d0f52ebc1d02 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.892767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf78a56-0075-41e7-86d3-e29713457ac4 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.934090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190ee5e-6540-4299-9d59-c1b1fb9c8fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.934794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ee5e-6540-4299-9d59-c1b1fb9c8fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.935090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ee5e-6540-4299-9d59-c1b1fb9c8fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.935346 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ee5e-6540-4299-9d59-c1b1fb9c8fb5 None admin] PATH_INFO: `/v3/users/0a93958dc36d405ca08e9b4f3abac845` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.936537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190ee5e-6540-4299-9d59-c1b1fb9c8fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=0a93958dc36d405ca08e9b4f3abac845)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:37.937000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96a402-73ac-44e2-948c-ba28f4cdc540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.937637 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96a402-73ac-44e2-948c-ba28f4cdc540 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.937920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96a402-73ac-44e2-948c-ba28f4cdc540 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.938014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190ee5e-6540-4299-9d59-c1b1fb9c8fb5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:37.938227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96a402-73ac-44e2-948c-ba28f4cdc540 None admin] PATH_INFO: `/v3/users/e69e4dd700a546be8503ce5bc558ff5b` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.939355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96a402-73ac-44e2-948c-ba28f4cdc540 None admin] RBAC: Authorizing `identity:get_user(user_id=e69e4dd700a546be8503ce5bc558ff5b)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:37.939878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 165/331] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/users/0a93958dc36d405ca08e9b4f3abac845 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:37.941053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96a402-73ac-44e2-948c-ba28f4cdc540 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:37.942920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 167/332] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/users/e69e4dd700a546be8503ce5bc558ff5b => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:37.948577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190ee5e-6540-4299-9d59-c1b1fb9c8fb5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.948948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96a402-73ac-44e2-948c-ba28f4cdc540 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.988882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:38.077825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96a402-73ac-44e2-948c-ba28f4cdc540 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:38.082690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190ee5e-6540-4299-9d59-c1b1fb9c8fb5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:38.120346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:38.123459 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936c3c1-bd5f-483e-aedd-20b7f304a829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:38.124128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936c3c1-bd5f-483e-aedd-20b7f304a829 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:38.124412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936c3c1-bd5f-483e-aedd-20b7f304a829 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:38.124812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936c3c1-bd5f-483e-aedd-20b7f304a829 None admin] PATH_INFO: `/v3/system/users/e69e4dd700a546be8503ce5bc558ff5b/roles/7bf20f00c3594a4ab1e58f1b118fc3e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:38.126173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936c3c1-bd5f-483e-aedd-20b7f304a829 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e69e4dd700a546be8503ce5bc558ff5b, role_id=7bf20f00c3594a4ab1e58f1b118fc3e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:38.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936c3c1-bd5f-483e-aedd-20b7f304a829 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:38.130635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d958cf-9f0f-4aab-a5ad-719811e201b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:38.130635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d958cf-9f0f-4aab-a5ad-719811e201b3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:38.130635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d958cf-9f0f-4aab-a5ad-719811e201b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:38.130958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d958cf-9f0f-4aab-a5ad-719811e201b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:38.131752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d958cf-9f0f-4aab-a5ad-719811e201b3 None admin] RBAC: Adding query filter params (role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, user.id=0a93958dc36d405ca08e9b4f3abac845, scope.system=all) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:38.132129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d958cf-9f0f-4aab-a5ad-719811e201b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:38.133629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d958cf-9f0f-4aab-a5ad-719811e201b3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:38.147414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 168/333] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/role_assignments?user.id=0a93958dc36d405ca08e9b4f3abac845&scope.system=all&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:38.277822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 166/334] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Aug 22 12:26:37 2022] PUT /identity/v3/system/users/e69e4dd700a546be8503ce5bc558ff5b/roles/7bf20f00c3594a4ab1e58f1b118fc3e8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:26:39.750025 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a3fd-5c2f-4c7b-8593-0433917312da None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:39.750566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a3fd-5c2f-4c7b-8593-0433917312da None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:39.750674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a3fd-5c2f-4c7b-8593-0433917312da None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:39.752184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 169/335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:39.758881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a83d2-aeb7-41ba-a55e-d756168722c7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:39.759310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a83d2-aeb7-41ba-a55e-d756168722c7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:39.759489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a83d2-aeb7-41ba-a55e-d756168722c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:39.783458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2f6a83d2-aeb7-41ba-a55e-d756168722c7 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:39.784656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2f6a83d2-aeb7-41ba-a55e-d756168722c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:39.869946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 167/336] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:40.435753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7a3fd-5c2f-4c7b-8593-0433917312da None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:40.563744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7a3fd-5c2f-4c7b-8593-0433917312da None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:40.614977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc42d2c-ca2e-4505-98fe-721f35b44bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:40.615629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc42d2c-ca2e-4505-98fe-721f35b44bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:40.615912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc42d2c-ca2e-4505-98fe-721f35b44bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:40.616186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc42d2c-ca2e-4505-98fe-721f35b44bd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:40.631431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc42d2c-ca2e-4505-98fe-721f35b44bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-dbc42d2c-ca2e-4505-98fe-721f35b44bd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:40.636210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:40.637091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:40.637916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 170/337] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:40.643387 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a83d2-aeb7-41ba-a55e-d756168722c7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:40.669553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:40.758568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a83d2-aeb7-41ba-a55e-d756168722c7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:40.800873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25796c3d-36f6-47f0-8a8c-fef10ee1e246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:40.801520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25796c3d-36f6-47f0-8a8c-fef10ee1e246 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:40.801765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25796c3d-36f6-47f0-8a8c-fef10ee1e246 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:40.802604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25796c3d-36f6-47f0-8a8c-fef10ee1e246 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:40.803319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25796c3d-36f6-47f0-8a8c-fef10ee1e246 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:40.803625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25796c3d-36f6-47f0-8a8c-fef10ee1e246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:40.805019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25796c3d-36f6-47f0-8a8c-fef10ee1e246 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:40.818279 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 168/338] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:40.823773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc42d2c-ca2e-4505-98fe-721f35b44bd4 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:40.886139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:40.916696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f52d-93a5-4a3f-9cdb-25be3e92ac9f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:40.917001 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f52d-93a5-4a3f-9cdb-25be3e92ac9f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:40.917252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f52d-93a5-4a3f-9cdb-25be3e92ac9f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:40.918625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 169/339] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:40.923723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648881b5-92a0-4f8c-9312-cc6fd2aef55e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:40.924011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648881b5-92a0-4f8c-9312-cc6fd2aef55e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:40.924288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648881b5-92a0-4f8c-9312-cc6fd2aef55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:40.950406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-648881b5-92a0-4f8c-9312-cc6fd2aef55e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:40.953906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-648881b5-92a0-4f8c-9312-cc6fd2aef55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:40.986244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc42d2c-ca2e-4505-98fe-721f35b44bd4 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.037705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874cb3-8020-4107-b78e-a5612484ad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.038363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874cb3-8020-4107-b78e-a5612484ad8a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.038700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874cb3-8020-4107-b78e-a5612484ad8a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.038903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874cb3-8020-4107-b78e-a5612484ad8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.064801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 170/340] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:41.066365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee3c7-1ea1-49d1-a941-fede40950d7c None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.066653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee3c7-1ea1-49d1-a941-fede40950d7c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.066933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee3c7-1ea1-49d1-a941-fede40950d7c None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.068410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 171/341] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:41.072756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db22a-e2b0-42c0-a3ce-1ddaaf614c84 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.072756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db22a-e2b0-42c0-a3ce-1ddaaf614c84 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.072756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db22a-e2b0-42c0-a3ce-1ddaaf614c84 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.072756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 172/342] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:41.079720 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5eba-f2bb-4e18-99e7-ce0618891fe9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.080008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5eba-f2bb-4e18-99e7-ce0618891fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.080284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5eba-f2bb-4e18-99e7-ce0618891fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.100715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5cca5eba-f2bb-4e18-99e7-ce0618891fe9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:41.101923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5cca5eba-f2bb-4e18-99e7-ce0618891fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:41.116528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.132742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874cb3-8020-4107-b78e-a5612484ad8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:41.135157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874cb3-8020-4107-b78e-a5612484ad8a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:41.194619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.196014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 173/343] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:41.197787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8cca-4600-4397-b88a-770b2ff9cff0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.202489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8cca-4600-4397-b88a-770b2ff9cff0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.203117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8cca-4600-4397-b88a-770b2ff9cff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.234175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-be2e8cca-4600-4397-b88a-770b2ff9cff0 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:41.235755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-be2e8cca-4600-4397-b88a-770b2ff9cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:41.257581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 171/344] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:41.266352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874cb3-8020-4107-b78e-a5612484ad8a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.368125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 174/345] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:41.394091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a54645-3788-4002-b3ef-66ff7a60f6cd None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.394740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a54645-3788-4002-b3ef-66ff7a60f6cd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.395799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a54645-3788-4002-b3ef-66ff7a60f6cd None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.398087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 175/346] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:41.403373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6d222-d0cd-4293-a180-03e08b5fe404 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.403668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6d222-d0cd-4293-a180-03e08b5fe404 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.403947 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6d222-d0cd-4293-a180-03e08b5fe404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.428070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-97d6d222-d0cd-4293-a180-03e08b5fe404 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:41.429584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-97d6d222-d0cd-4293-a180-03e08b5fe404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:41.447829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874cb3-8020-4107-b78e-a5612484ad8a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.510377 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4db9b-49d6-4168-8cfe-1df2ec9e47a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.511583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4db9b-49d6-4168-8cfe-1df2ec9e47a3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.511862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4db9b-49d6-4168-8cfe-1df2ec9e47a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.512137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4db9b-49d6-4168-8cfe-1df2ec9e47a3 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.514215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4db9b-49d6-4168-8cfe-1df2ec9e47a3 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:41.516976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4db9b-49d6-4168-8cfe-1df2ec9e47a3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:41.519614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 172/347] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:41.520380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4db9b-49d6-4168-8cfe-1df2ec9e47a3 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.549783 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 176/348] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:41.550673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6d222-d0cd-4293-a180-03e08b5fe404 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.558538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.566695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.725869 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4db9b-49d6-4168-8cfe-1df2ec9e47a3 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.735706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6d222-d0cd-4293-a180-03e08b5fe404 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.777460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d48c3a-c2d1-4d2a-97e4-8e312ec852a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.778432 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48c3a-c2d1-4d2a-97e4-8e312ec852a7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.778885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48c3a-c2d1-4d2a-97e4-8e312ec852a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.779322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48c3a-c2d1-4d2a-97e4-8e312ec852a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.785010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96894fcc-62b0-42a6-a557-3af55bec5c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.785657 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96894fcc-62b0-42a6-a557-3af55bec5c13 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.785955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96894fcc-62b0-42a6-a557-3af55bec5c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.786268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96894fcc-62b0-42a6-a557-3af55bec5c13 None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.794411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d48c3a-c2d1-4d2a-97e4-8e312ec852a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:41.794816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96894fcc-62b0-42a6-a557-3af55bec5c13 None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:41.796274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96894fcc-62b0-42a6-a557-3af55bec5c13 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:41.798857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 177/349] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:41.798857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96894fcc-62b0-42a6-a557-3af55bec5c13 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-43d48c3a-c2d1-4d2a-97e4-8e312ec852a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:41.801538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:41.803347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:41.804223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:41.806438 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 173/350] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:41.807393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d48c3a-c2d1-4d2a-97e4-8e312ec852a7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.885149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.914697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.918345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96894fcc-62b0-42a6-a557-3af55bec5c13 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.932266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d48c3a-c2d1-4d2a-97e4-8e312ec852a7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.961149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc30a-c0c8-4c87-b2ae-3964b334e717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.961929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc30a-c0c8-4c87-b2ae-3964b334e717 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.962361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc30a-c0c8-4c87-b2ae-3964b334e717 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.962558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc30a-c0c8-4c87-b2ae-3964b334e717 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.975520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbc30a-c0c8-4c87-b2ae-3964b334e717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-79cbc30a-c0c8-4c87-b2ae-3964b334e717 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:41.980877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:41.981793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:41.982655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 178/351] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:41.983336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc30a-c0c8-4c87-b2ae-3964b334e717 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.984019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed76c6-71a9-4e07-bedd-c57378c53d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.984667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed76c6-71a9-4e07-bedd-c57378c53d62 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.984948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed76c6-71a9-4e07-bedd-c57378c53d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.985247 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed76c6-71a9-4e07-bedd-c57378c53d62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.005676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed76c6-71a9-4e07-bedd-c57378c53d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-3fed76c6-71a9-4e07-bedd-c57378c53d62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:42.012344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:42.013251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:42.014058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 174/352] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:42.014762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed76c6-71a9-4e07-bedd-c57378c53d62 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.112107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc30a-c0c8-4c87-b2ae-3964b334e717 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.147484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.154484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7f94b-1d4c-4dab-8b4b-ee35d6ee6507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.155098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f94b-1d4c-4dab-8b4b-ee35d6ee6507 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.155537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f94b-1d4c-4dab-8b4b-ee35d6ee6507 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.155822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f94b-1d4c-4dab-8b4b-ee35d6ee6507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.156884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7f94b-1d4c-4dab-8b4b-ee35d6ee6507 None admin] RBAC: Adding query filter params (group.id=ba14b31496534ffa84ddf7201297e04d, role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:42.162465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7f94b-1d4c-4dab-8b4b-ee35d6ee6507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.162465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7f94b-1d4c-4dab-8b4b-ee35d6ee6507 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.162653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed76c6-71a9-4e07-bedd-c57378c53d62 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.166244 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 179/353] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/role_assignments?group.id=ba14b31496534ffa84ddf7201297e04d&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.166917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7f94b-1d4c-4dab-8b4b-ee35d6ee6507 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.212324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5aae2-74cd-4e14-9c84-fdb6f5ab91a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.213211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5aae2-74cd-4e14-9c84-fdb6f5ab91a8 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.213638 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5aae2-74cd-4e14-9c84-fdb6f5ab91a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.214056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5aae2-74cd-4e14-9c84-fdb6f5ab91a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.215058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5aae2-74cd-4e14-9c84-fdb6f5ab91a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:42.215507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5aae2-74cd-4e14-9c84-fdb6f5ab91a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.217109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5aae2-74cd-4e14-9c84-fdb6f5ab91a8 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.219150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.228759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 175/354] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.229929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5aae2-74cd-4e14-9c84-fdb6f5ab91a8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.306389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7f94b-1d4c-4dab-8b4b-ee35d6ee6507 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.350938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5aae2-74cd-4e14-9c84-fdb6f5ab91a8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.359974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f2119-95fb-4825-b6ab-ca77b8e146e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.360622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2119-95fb-4825-b6ab-ca77b8e146e4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.360903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2119-95fb-4825-b6ab-ca77b8e146e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.361178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2119-95fb-4825-b6ab-ca77b8e146e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.377086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f2119-95fb-4825-b6ab-ca77b8e146e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-bf8f2119-95fb-4825-b6ab-ca77b8e146e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:42.382582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:42.383608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:42.384453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 180/355] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:42.385137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f2119-95fb-4825-b6ab-ca77b8e146e4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.401833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b005490-74ba-44be-818e-8d90725bbc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.402498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005490-74ba-44be-818e-8d90725bbc46 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.402779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005490-74ba-44be-818e-8d90725bbc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.403053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005490-74ba-44be-818e-8d90725bbc46 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.403726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b005490-74ba-44be-818e-8d90725bbc46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:42.404034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b005490-74ba-44be-818e-8d90725bbc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.405438 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b005490-74ba-44be-818e-8d90725bbc46 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.417132 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 176/356] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.417806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b005490-74ba-44be-818e-8d90725bbc46 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.457121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.487974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.517748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f2119-95fb-4825-b6ab-ca77b8e146e4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.545015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b005490-74ba-44be-818e-8d90725bbc46 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.562333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cded92-7e65-4b25-9949-5ff3c3cc31aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cded92-7e65-4b25-9949-5ff3c3cc31aa None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.563573 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cded92-7e65-4b25-9949-5ff3c3cc31aa None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.563863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cded92-7e65-4b25-9949-5ff3c3cc31aa None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.565263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cded92-7e65-4b25-9949-5ff3c3cc31aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:42.565263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cded92-7e65-4b25-9949-5ff3c3cc31aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.567311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cded92-7e65-4b25-9949-5ff3c3cc31aa None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.577045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 181/357] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.578041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef407ff-6dfe-486e-8067-9d87988d6b93 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.578361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef407ff-6dfe-486e-8067-9d87988d6b93 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.578641 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef407ff-6dfe-486e-8067-9d87988d6b93 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.579866 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 182/358] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:42.580566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef407ff-6dfe-486e-8067-9d87988d6b93 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.596243 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2501e6-f52e-4ab5-b032-ca204e82017b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.596874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2501e6-f52e-4ab5-b032-ca204e82017b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.597159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2501e6-f52e-4ab5-b032-ca204e82017b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.597435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2501e6-f52e-4ab5-b032-ca204e82017b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.681009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2501e6-f52e-4ab5-b032-ca204e82017b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.682482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2501e6-f52e-4ab5-b032-ca204e82017b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.711391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef407ff-6dfe-486e-8067-9d87988d6b93 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.729745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.753330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eca8fa-6db0-47e2-9fce-aa764fc8fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.753943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eca8fa-6db0-47e2-9fce-aa764fc8fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.754237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eca8fa-6db0-47e2-9fce-aa764fc8fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.754528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eca8fa-6db0-47e2-9fce-aa764fc8fdb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.755926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eca8fa-6db0-47e2-9fce-aa764fc8fdb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:42.756238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eca8fa-6db0-47e2-9fce-aa764fc8fdb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.757928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eca8fa-6db0-47e2-9fce-aa764fc8fdb7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.760951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.767864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 183/359] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.768519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eca8fa-6db0-47e2-9fce-aa764fc8fdb7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.821624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 177/360] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:42.823930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2501e6-f52e-4ab5-b032-ca204e82017b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.897040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eca8fa-6db0-47e2-9fce-aa764fc8fdb7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.938933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2501e6-f52e-4ab5-b032-ca204e82017b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.941181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75d9e2-03c4-4dbe-b92b-18fd6bba1fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.941824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75d9e2-03c4-4dbe-b92b-18fd6bba1fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.944843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75d9e2-03c4-4dbe-b92b-18fd6bba1fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.944843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75d9e2-03c4-4dbe-b92b-18fd6bba1fa9 None admin] PATH_INFO: `/v3/users/e69e4dd700a546be8503ce5bc558ff5b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.944843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75d9e2-03c4-4dbe-b92b-18fd6bba1fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=e69e4dd700a546be8503ce5bc558ff5b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.945753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75d9e2-03c4-4dbe-b92b-18fd6bba1fa9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.947543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 184/361] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/users/e69e4dd700a546be8503ce5bc558ff5b => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.949924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e11327-1968-458d-b12a-4d18bd234a98 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.950229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e11327-1968-458d-b12a-4d18bd234a98 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.950545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e11327-1968-458d-b12a-4d18bd234a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.972661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-17e11327-1968-458d-b12a-4d18bd234a98 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:42.973878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-17e11327-1968-458d-b12a-4d18bd234a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:42.982784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ee3f1-83f9-4298-8908-b01ed0dd4b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.983523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee3f1-83f9-4298-8908-b01ed0dd4b15 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.983789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee3f1-83f9-4298-8908-b01ed0dd4b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.984072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee3f1-83f9-4298-8908-b01ed0dd4b15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.015720 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.023570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.054715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 185/362] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:43.056051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e11327-1968-458d-b12a-4d18bd234a98 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.072386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ee3f1-83f9-4298-8908-b01ed0dd4b15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.074138 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ee3f1-83f9-4298-8908-b01ed0dd4b15 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.168689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e11327-1968-458d-b12a-4d18bd234a98 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.205490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 178/363] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:43.206724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ee3f1-83f9-4298-8908-b01ed0dd4b15 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.217432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430784a7-e18a-4bd1-8628-4377cccf9172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.217991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430784a7-e18a-4bd1-8628-4377cccf9172 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.218324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430784a7-e18a-4bd1-8628-4377cccf9172 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.218592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430784a7-e18a-4bd1-8628-4377cccf9172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.269325 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.276416 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.295008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430784a7-e18a-4bd1-8628-4377cccf9172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.296599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430784a7-e18a-4bd1-8628-4377cccf9172 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.325031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ee3f1-83f9-4298-8908-b01ed0dd4b15 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.364346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23f668-a809-4f51-ac55-4f51b6dc1cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.365343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23f668-a809-4f51-ac55-4f51b6dc1cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.365815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23f668-a809-4f51-ac55-4f51b6dc1cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.366312 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23f668-a809-4f51-ac55-4f51b6dc1cb0 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.367761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23f668-a809-4f51-ac55-4f51b6dc1cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.370293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23f668-a809-4f51-ac55-4f51b6dc1cb0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.372282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 179/364] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.373240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23f668-a809-4f51-ac55-4f51b6dc1cb0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.420308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 186/365] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:43.420514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430784a7-e18a-4bd1-8628-4377cccf9172 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.501729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23f668-a809-4f51-ac55-4f51b6dc1cb0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.525455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.538935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.551086 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4563c-9ede-4701-bea1-19a9640b76e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.552793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4563c-9ede-4701-bea1-19a9640b76e4 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.553143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4563c-9ede-4701-bea1-19a9640b76e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.553419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4563c-9ede-4701-bea1-19a9640b76e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.554151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4563c-9ede-4701-bea1-19a9640b76e4 None admin] RBAC: Adding query filter params (role.id=7bf20f00c3594a4ab1e58f1b118fc3e8, user.id=e69e4dd700a546be8503ce5bc558ff5b, scope.system=all) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:43.554545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4563c-9ede-4701-bea1-19a9640b76e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.556067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4563c-9ede-4701-bea1-19a9640b76e4 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.559841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430784a7-e18a-4bd1-8628-4377cccf9172 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.570214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 180/366] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/role_assignments?user.id=e69e4dd700a546be8503ce5bc558ff5b&scope.system=all&role.id=7bf20f00c3594a4ab1e58f1b118fc3e8 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.571046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4563c-9ede-4701-bea1-19a9640b76e4 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.601214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa91f06-13cf-4287-b261-4a36d1b5e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.601793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa91f06-13cf-4287-b261-4a36d1b5e6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.602077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa91f06-13cf-4287-b261-4a36d1b5e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.602392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa91f06-13cf-4287-b261-4a36d1b5e6e5 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.604194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa91f06-13cf-4287-b261-4a36d1b5e6e5 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.605779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa91f06-13cf-4287-b261-4a36d1b5e6e5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.607760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 187/367] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.608584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa91f06-13cf-4287-b261-4a36d1b5e6e5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.720570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4563c-9ede-4701-bea1-19a9640b76e4 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.733370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa91f06-13cf-4287-b261-4a36d1b5e6e5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.762890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232c06f-ef35-4374-b875-cd486aafe3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.763939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232c06f-ef35-4374-b875-cd486aafe3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.764542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232c06f-ef35-4374-b875-cd486aafe3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.765130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232c06f-ef35-4374-b875-cd486aafe3d7 None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.766513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232c06f-ef35-4374-b875-cd486aafe3d7 None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.768429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232c06f-ef35-4374-b875-cd486aafe3d7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.770390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 181/368] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.771964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232c06f-ef35-4374-b875-cd486aafe3d7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.777196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dc539-5890-46d8-b3ae-4285d429f299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.777196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dc539-5890-46d8-b3ae-4285d429f299 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.777196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dc539-5890-46d8-b3ae-4285d429f299 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.777196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dc539-5890-46d8-b3ae-4285d429f299 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.790434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dc539-5890-46d8-b3ae-4285d429f299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-348dc539-5890-46d8-b3ae-4285d429f299 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:43.797025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:43.798235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 188/369] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:43.799170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dc539-5890-46d8-b3ae-4285d429f299 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.806921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.849037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.917908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232c06f-ef35-4374-b875-cd486aafe3d7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.930140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dc539-5890-46d8-b3ae-4285d429f299 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.961554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30831eae-7240-449b-a281-959b3f9a03dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.962220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30831eae-7240-449b-a281-959b3f9a03dd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.962522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30831eae-7240-449b-a281-959b3f9a03dd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.962806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30831eae-7240-449b-a281-959b3f9a03dd None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.963957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30831eae-7240-449b-a281-959b3f9a03dd None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.965424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30831eae-7240-449b-a281-959b3f9a03dd None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.967453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 182/370] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.968345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30831eae-7240-449b-a281-959b3f9a03dd None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.971441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a83f-2d75-4401-8071-fe501f62ccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.972660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a83f-2d75-4401-8071-fe501f62ccd1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.973176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a83f-2d75-4401-8071-fe501f62ccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.973756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a83f-2d75-4401-8071-fe501f62ccd1 None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.976497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2a83f-2d75-4401-8071-fe501f62ccd1 None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.978179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2a83f-2d75-4401-8071-fe501f62ccd1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.980030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 189/371] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.981073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a83f-2d75-4401-8071-fe501f62ccd1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.066561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.095582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30831eae-7240-449b-a281-959b3f9a03dd None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.096518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a83f-2d75-4401-8071-fe501f62ccd1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.119781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.142637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69086c70-eead-4604-a998-a94fffa01fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.143067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48997eff-30b4-4552-bfa5-5d6044de975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.143260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69086c70-eead-4604-a998-a94fffa01fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.143543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69086c70-eead-4604-a998-a94fffa01fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.143816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69086c70-eead-4604-a998-a94fffa01fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.144049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48997eff-30b4-4552-bfa5-5d6044de975f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.144428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48997eff-30b4-4552-bfa5-5d6044de975f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.144534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69086c70-eead-4604-a998-a94fffa01fe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:44.144784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69086c70-eead-4604-a998-a94fffa01fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.144964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48997eff-30b4-4552-bfa5-5d6044de975f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.145925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48997eff-30b4-4552-bfa5-5d6044de975f None admin] RBAC: Adding query filter params (group.id=ba14b31496534ffa84ddf7201297e04d, role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:44.146461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69086c70-eead-4604-a998-a94fffa01fe8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.146585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48997eff-30b4-4552-bfa5-5d6044de975f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.148188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48997eff-30b4-4552-bfa5-5d6044de975f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.154895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 183/372] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/role_assignments?group.id=ba14b31496534ffa84ddf7201297e04d&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.155558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48997eff-30b4-4552-bfa5-5d6044de975f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.157246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 190/373] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.163241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69086c70-eead-4604-a998-a94fffa01fe8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.295437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48997eff-30b4-4552-bfa5-5d6044de975f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.306857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69086c70-eead-4604-a998-a94fffa01fe8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.340441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd8df3-84ad-4c6c-b814-550e6f2f4bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.341558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd8df3-84ad-4c6c-b814-550e6f2f4bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.342098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd8df3-84ad-4c6c-b814-550e6f2f4bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.342413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd8df3-84ad-4c6c-b814-550e6f2f4bd7 None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.343860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd8df3-84ad-4c6c-b814-550e6f2f4bd7 None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.345819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd8df3-84ad-4c6c-b814-550e6f2f4bd7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.348116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 184/374] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.349020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd8df3-84ad-4c6c-b814-550e6f2f4bd7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.350831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382edf9-da9b-4d33-aa4b-d0018573bb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.351455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382edf9-da9b-4d33-aa4b-d0018573bb3a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.352081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382edf9-da9b-4d33-aa4b-d0018573bb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.352365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382edf9-da9b-4d33-aa4b-d0018573bb3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.354266 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382edf9-da9b-4d33-aa4b-d0018573bb3a None admin] RBAC: Adding query filter params (group.id=ba14b31496534ffa84ddf7201297e04d, role.id=60c41aabe4694d07bf0b66f5223c3d0d, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:44.354812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382edf9-da9b-4d33-aa4b-d0018573bb3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.356424 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382edf9-da9b-4d33-aa4b-d0018573bb3a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.358577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.363850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 191/375] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/role_assignments?group.id=ba14b31496534ffa84ddf7201297e04d&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=60c41aabe4694d07bf0b66f5223c3d0d => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.365623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902f51-52a3-476d-9487-f58c213ec891 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.366289 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902f51-52a3-476d-9487-f58c213ec891 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.366492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902f51-52a3-476d-9487-f58c213ec891 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.370300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 192/376] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:44.370300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902f51-52a3-476d-9487-f58c213ec891 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.427324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.511988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd8df3-84ad-4c6c-b814-550e6f2f4bd7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.521800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902f51-52a3-476d-9487-f58c213ec891 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.558791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5c780-d066-4142-a42b-d373e4c7947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.559692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5c780-d066-4142-a42b-d373e4c7947a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.559983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5c780-d066-4142-a42b-d373e4c7947a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.560260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5c780-d066-4142-a42b-d373e4c7947a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.566569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ae250-2b12-4cbf-8a25-5761309b95e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.567276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ae250-2b12-4cbf-8a25-5761309b95e1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.568626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ae250-2b12-4cbf-8a25-5761309b95e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.568982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ae250-2b12-4cbf-8a25-5761309b95e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.569795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ae250-2b12-4cbf-8a25-5761309b95e1 None admin] RBAC: Adding query filter params (group.id=ba14b31496534ffa84ddf7201297e04d, role.id=60c41aabe4694d07bf0b66f5223c3d0d, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:44.570186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ae250-2b12-4cbf-8a25-5761309b95e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.571770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ae250-2b12-4cbf-8a25-5761309b95e1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.582053 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 193/377] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/role_assignments?group.id=ba14b31496534ffa84ddf7201297e04d&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=60c41aabe4694d07bf0b66f5223c3d0d => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.583509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7b56-182c-41e8-88b4-648fb80c480d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.584063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7b56-182c-41e8-88b4-648fb80c480d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.584345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7b56-182c-41e8-88b4-648fb80c480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.627392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-178f7b56-182c-41e8-88b4-648fb80c480d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:44.628621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-178f7b56-182c-41e8-88b4-648fb80c480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:44.654030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5c780-d066-4142-a42b-d373e4c7947a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.655623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5c780-d066-4142-a42b-d373e4c7947a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.715888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.716945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.732662 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 194/378] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:44.773812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 185/379] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:44.779840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f7b56-182c-41e8-88b4-648fb80c480d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.909643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f7b56-182c-41e8-88b4-648fb80c480d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.953990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc48cd-3628-4a3c-8ef4-698adbec6dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.954671 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc48cd-3628-4a3c-8ef4-698adbec6dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.954936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc48cd-3628-4a3c-8ef4-698adbec6dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.955213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc48cd-3628-4a3c-8ef4-698adbec6dd1 None admin] PATH_INFO: `/v3/projects/6699bdfe1f6a452e99cfdff2e04fc5e9` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.958994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc48cd-3628-4a3c-8ef4-698adbec6dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=6699bdfe1f6a452e99cfdff2e04fc5e9)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.960534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc48cd-3628-4a3c-8ef4-698adbec6dd1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.962568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 195/380] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/projects/6699bdfe1f6a452e99cfdff2e04fc5e9 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.968282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5c780-d066-4142-a42b-d373e4c7947a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:45.074630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc48cd-3628-4a3c-8ef4-698adbec6dd1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:45.091523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5c780-d066-4142-a42b-d373e4c7947a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:45.142503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6ca39-916c-4c44-ad7c-9b876fbde3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.144091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ca39-916c-4c44-ad7c-9b876fbde3ae None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.144865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ca39-916c-4c44-ad7c-9b876fbde3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.145354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ca39-916c-4c44-ad7c-9b876fbde3ae None admin] PATH_INFO: `/v3/groups/5d56458356cc43f0b4a354129841e6c2` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.151065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:45.156311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6ca39-916c-4c44-ad7c-9b876fbde3ae None admin] RBAC: Authorizing `identity:get_group(group_id=5d56458356cc43f0b4a354129841e6c2)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:45.158227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6ca39-916c-4c44-ad7c-9b876fbde3ae None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:45.161834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 186/381] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/groups/5d56458356cc43f0b4a354129841e6c2 => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:45.168858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6ca39-916c-4c44-ad7c-9b876fbde3ae None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:45.194741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:45.204809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc48cd-3628-4a3c-8ef4-698adbec6dd1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:45.257044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062991-44af-4536-97be-845e673b1657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.257696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062991-44af-4536-97be-845e673b1657 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.257980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062991-44af-4536-97be-845e673b1657 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.258280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062991-44af-4536-97be-845e673b1657 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.283530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92062991-44af-4536-97be-845e673b1657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-92062991-44af-4536-97be-845e673b1657 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:45.289211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:45.290116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:45.290967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:45.292398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 196/382] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:45.299965 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062991-44af-4536-97be-845e673b1657 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:45.335256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6ca39-916c-4c44-ad7c-9b876fbde3ae None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:45.408999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1119a-3bfc-43a8-8eb5-cfa129e68f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.409625 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1119a-3bfc-43a8-8eb5-cfa129e68f97 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.409910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1119a-3bfc-43a8-8eb5-cfa129e68f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.410202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1119a-3bfc-43a8-8eb5-cfa129e68f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.410951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1119a-3bfc-43a8-8eb5-cfa129e68f97 None admin] RBAC: Adding query filter params (group.id=5d56458356cc43f0b4a354129841e6c2, role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=6699bdfe1f6a452e99cfdff2e04fc5e9) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:45.411338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1119a-3bfc-43a8-8eb5-cfa129e68f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:45.412802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1119a-3bfc-43a8-8eb5-cfa129e68f97 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:45.422670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 187/383] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:45 2022] GET /identity/v3/role_assignments?group.id=5d56458356cc43f0b4a354129841e6c2&scope.project.id=6699bdfe1f6a452e99cfdff2e04fc5e9&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:45.445633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062991-44af-4536-97be-845e673b1657 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:45.469245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:45.490331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaf1c4-6b3b-4e67-b478-ab019f0dae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.490967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaf1c4-6b3b-4e67-b478-ab019f0dae60 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.491245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaf1c4-6b3b-4e67-b478-ab019f0dae60 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.491519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaf1c4-6b3b-4e67-b478-ab019f0dae60 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.492194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaf1c4-6b3b-4e67-b478-ab019f0dae60 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:45.492501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaf1c4-6b3b-4e67-b478-ab019f0dae60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:45.493898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaf1c4-6b3b-4e67-b478-ab019f0dae60 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:45.507681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 197/384] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:45.513909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1119a-3bfc-43a8-8eb5-cfa129e68f97 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:45.639431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:45.686358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1119a-3bfc-43a8-8eb5-cfa129e68f97 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:45.735382 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7c515-8ac4-4dd0-8a9a-9da5fb9a988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.736034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7c515-8ac4-4dd0-8a9a-9da5fb9a988e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.739824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7c515-8ac4-4dd0-8a9a-9da5fb9a988e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.739824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7c515-8ac4-4dd0-8a9a-9da5fb9a988e None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.739824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7c515-8ac4-4dd0-8a9a-9da5fb9a988e None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:45.740396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7c515-8ac4-4dd0-8a9a-9da5fb9a988e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:45.742428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 188/385] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:45 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:45.747716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaf1c4-6b3b-4e67-b478-ab019f0dae60 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:45.901478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaf1c4-6b3b-4e67-b478-ab019f0dae60 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:45.947837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6eeaa-25c4-4b1a-b9e4-1a3d26824117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.948485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6eeaa-25c4-4b1a-b9e4-1a3d26824117 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.948766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6eeaa-25c4-4b1a-b9e4-1a3d26824117 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.949043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6eeaa-25c4-4b1a-b9e4-1a3d26824117 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.954869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6eeaa-25c4-4b1a-b9e4-1a3d26824117 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:45.956315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6eeaa-25c4-4b1a-b9e4-1a3d26824117 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:45.958363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 198/386] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:45 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:45.971759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7c515-8ac4-4dd0-8a9a-9da5fb9a988e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:46.205980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7c515-8ac4-4dd0-8a9a-9da5fb9a988e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:46.284369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28053dd-d676-4aae-821e-4e663b3935bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:46.285050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28053dd-d676-4aae-821e-4e663b3935bc None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:46.285338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28053dd-d676-4aae-821e-4e663b3935bc None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:46.285619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28053dd-d676-4aae-821e-4e663b3935bc None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/groups/ba14b31496534ffa84ddf7201297e04d/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:46.287679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28053dd-d676-4aae-821e-4e663b3935bc None admin] RBAC: Authorizing `identity:create_grant(project_id=e608f657ec954895ae35c7bd1b8fa6ea, group_id=ba14b31496534ffa84ddf7201297e04d, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:46.289137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28053dd-d676-4aae-821e-4e663b3935bc None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:46.378586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 189/387] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 22 12:26:45 2022] PUT /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/groups/ba14b31496534ffa84ddf7201297e04d/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:46.644615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5f475-a7e4-4f2f-8a34-7a52d953e527 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:46.644912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5f475-a7e4-4f2f-8a34-7a52d953e527 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:46.645476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5f475-a7e4-4f2f-8a34-7a52d953e527 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:46.647370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 199/388] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:46.655750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865157c-a9ad-4eb8-9d0a-565a9322154b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:46.656045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865157c-a9ad-4eb8-9d0a-565a9322154b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:46.656327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865157c-a9ad-4eb8-9d0a-565a9322154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:46.678620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-f865157c-a9ad-4eb8-9d0a-565a9322154b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:46.679829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f865157c-a9ad-4eb8-9d0a-565a9322154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:46.682181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:46.766438 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 190/389] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:47.129406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0c4da-7696-42ac-b7b2-cf17fbd821ba None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.130480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0c4da-7696-42ac-b7b2-cf17fbd821ba None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.130556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0c4da-7696-42ac-b7b2-cf17fbd821ba None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.131869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 200/390] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:47.137206 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5ff13-057f-4332-b3fc-58cbbb495f87 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.137694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5ff13-057f-4332-b3fc-58cbbb495f87 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.137863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5ff13-057f-4332-b3fc-58cbbb495f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.162441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-8dd5ff13-057f-4332-b3fc-58cbbb495f87 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:47.165615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0c4da-7696-42ac-b7b2-cf17fbd821ba None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.166542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8dd5ff13-057f-4332-b3fc-58cbbb495f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:47.242072 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:47.254339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 191/391] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:47.259735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcde27f-db12-4d09-b3eb-ee833bb05b98 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.264126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcde27f-db12-4d09-b3eb-ee833bb05b98 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.264126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcde27f-db12-4d09-b3eb-ee833bb05b98 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.264126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 192/392] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:47.267276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806ae3-7243-49cd-9c52-d4eb5ecfd578 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.267663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806ae3-7243-49cd-9c52-d4eb5ecfd578 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.268038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806ae3-7243-49cd-9c52-d4eb5ecfd578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.300733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0c4da-7696-42ac-b7b2-cf17fbd821ba None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:47.302420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-f4806ae3-7243-49cd-9c52-d4eb5ecfd578 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:47.303975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f4806ae3-7243-49cd-9c52-d4eb5ecfd578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:47.339156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284219d2-2fd4-4933-b59f-3c2665b3b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:47.340115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284219d2-2fd4-4933-b59f-3c2665b3b6dc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.340551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284219d2-2fd4-4933-b59f-3c2665b3b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.341012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284219d2-2fd4-4933-b59f-3c2665b3b6dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.352742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284219d2-2fd4-4933-b59f-3c2665b3b6dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-284219d2-2fd4-4933-b59f-3c2665b3b6dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:47.358766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:47.359851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:47.360856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:47.362846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 201/393] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:47.368607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284219d2-2fd4-4933-b59f-3c2665b3b6dc None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.462653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:47.463610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 193/394] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:47.521111 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284219d2-2fd4-4933-b59f-3c2665b3b6dc None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:47.544530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:47.557087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b334443-6609-4edb-a979-6f50439050e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:47.557928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b334443-6609-4edb-a979-6f50439050e5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.558385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b334443-6609-4edb-a979-6f50439050e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.558820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b334443-6609-4edb-a979-6f50439050e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.559747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b334443-6609-4edb-a979-6f50439050e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:47.560197 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b334443-6609-4edb-a979-6f50439050e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:47.561833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b334443-6609-4edb-a979-6f50439050e5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:47.562223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4806ae3-7243-49cd-9c52-d4eb5ecfd578 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.577518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 202/395] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:47.584386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b334443-6609-4edb-a979-6f50439050e5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.756253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4806ae3-7243-49cd-9c52-d4eb5ecfd578 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:47.767243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b334443-6609-4edb-a979-6f50439050e5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:47.831414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c91ce-d294-47ed-85e4-c00e84be7d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:47.832520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c91ce-d294-47ed-85e4-c00e84be7d4c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.833557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c91ce-d294-47ed-85e4-c00e84be7d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.834076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c91ce-d294-47ed-85e4-c00e84be7d4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.835323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b4b8-4329-4122-932d-7c26b09d779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:47.835973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b4b8-4329-4122-932d-7c26b09d779f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.836258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b4b8-4329-4122-932d-7c26b09d779f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.836534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b4b8-4329-4122-932d-7c26b09d779f None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.837649 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13b4b8-4329-4122-932d-7c26b09d779f None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:47.839133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13b4b8-4329-4122-932d-7c26b09d779f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:47.841056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 203/396] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:47 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:47.841813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b4b8-4329-4122-932d-7c26b09d779f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.852328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c91ce-d294-47ed-85e4-c00e84be7d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-d11c91ce-d294-47ed-85e4-c00e84be7d4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:47.857505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:47.858394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:47.859212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:47.861728 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 194/397] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:47.867065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c91ce-d294-47ed-85e4-c00e84be7d4c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.902589 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:47.933965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:47.946693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b4b8-4329-4122-932d-7c26b09d779f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:47.978794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c91ce-d294-47ed-85e4-c00e84be7d4c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:47.983906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4d3b7-fa78-4320-8b15-9e2f856cbf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:47.984705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4d3b7-fa78-4320-8b15-9e2f856cbf72 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.985131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4d3b7-fa78-4320-8b15-9e2f856cbf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.985576 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4d3b7-fa78-4320-8b15-9e2f856cbf72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.997356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4d3b7-fa78-4320-8b15-9e2f856cbf72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3bd4d3b7-fa78-4320-8b15-9e2f856cbf72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:48.002098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:48.006372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 204/398] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:48.007456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4d3b7-fa78-4320-8b15-9e2f856cbf72 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.023235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f14a4-4345-40d3-8dd8-88321fbb8809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.023875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f14a4-4345-40d3-8dd8-88321fbb8809 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.024157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f14a4-4345-40d3-8dd8-88321fbb8809 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.024431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f14a4-4345-40d3-8dd8-88321fbb8809 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.025730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f14a4-4345-40d3-8dd8-88321fbb8809 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.027208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f14a4-4345-40d3-8dd8-88321fbb8809 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.028964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 195/399] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:47 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:48.030086 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d815a3-1953-4239-a9d0-a706d2870770 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.030396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d815a3-1953-4239-a9d0-a706d2870770 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.030671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d815a3-1953-4239-a9d0-a706d2870770 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.031978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 196/400] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:48.035616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d815a3-1953-4239-a9d0-a706d2870770 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.114584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.117603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4d3b7-fa78-4320-8b15-9e2f856cbf72 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.151644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d815a3-1953-4239-a9d0-a706d2870770 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.156431 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d768c-31ed-4576-8b41-c943c26eb8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.157585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d768c-31ed-4576-8b41-c943c26eb8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.158085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d768c-31ed-4576-8b41-c943c26eb8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.158987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d768c-31ed-4576-8b41-c943c26eb8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.159867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d768c-31ed-4576-8b41-c943c26eb8d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:48.160399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d768c-31ed-4576-8b41-c943c26eb8d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.163180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d768c-31ed-4576-8b41-c943c26eb8d6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.183432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 205/401] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:48.183432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d768c-31ed-4576-8b41-c943c26eb8d6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.185673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.195602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3a169-1d6d-4d25-b11e-d712f5fa3b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.198965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3a169-1d6d-4d25-b11e-d712f5fa3b1f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.198965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3a169-1d6d-4d25-b11e-d712f5fa3b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.198965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3a169-1d6d-4d25-b11e-d712f5fa3b1f None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.198965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3a169-1d6d-4d25-b11e-d712f5fa3b1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:48.198965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3a169-1d6d-4d25-b11e-d712f5fa3b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.199351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3a169-1d6d-4d25-b11e-d712f5fa3b1f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.212747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 197/402] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:48.212747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21cab3-41bc-4b07-8df0-34cddc4a9870 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.212747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21cab3-41bc-4b07-8df0-34cddc4a9870 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.212747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21cab3-41bc-4b07-8df0-34cddc4a9870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.229053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5f21cab3-41bc-4b07-8df0-34cddc4a9870 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:48.230251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5f21cab3-41bc-4b07-8df0-34cddc4a9870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:48.293518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d768c-31ed-4576-8b41-c943c26eb8d6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.306677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 198/403] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:48.307348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21cab3-41bc-4b07-8df0-34cddc4a9870 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.345721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143b28-fe1e-4e50-89d6-5ab96f7e0a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.346798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143b28-fe1e-4e50-89d6-5ab96f7e0a18 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.347442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143b28-fe1e-4e50-89d6-5ab96f7e0a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.347925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143b28-fe1e-4e50-89d6-5ab96f7e0a18 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/groups/ba14b31496534ffa84ddf7201297e04d/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.351799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18143b28-fe1e-4e50-89d6-5ab96f7e0a18 None admin] RBAC: Authorizing `identity:create_grant(project_id=73350d92b0dd475bbfeeb9bf45131a54, group_id=ba14b31496534ffa84ddf7201297e04d, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.354298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18143b28-fe1e-4e50-89d6-5ab96f7e0a18 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.413406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21cab3-41bc-4b07-8df0-34cddc4a9870 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.432292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.448372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 206/404] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 22 12:26:48 2022] PUT /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/groups/ba14b31496534ffa84ddf7201297e04d/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:48.454466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f18b-d51c-4c0e-843b-7d76dcb90028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.454466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f18b-d51c-4c0e-843b-7d76dcb90028 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.454466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f18b-d51c-4c0e-843b-7d76dcb90028 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.454466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f18b-d51c-4c0e-843b-7d76dcb90028 None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.454821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386f18b-d51c-4c0e-843b-7d76dcb90028 None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.455520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386f18b-d51c-4c0e-843b-7d76dcb90028 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.456225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143b28-fe1e-4e50-89d6-5ab96f7e0a18 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.457427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 199/405] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:48.469874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f18b-d51c-4c0e-843b-7d76dcb90028 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.514798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.625394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f18b-d51c-4c0e-843b-7d76dcb90028 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.648479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143b28-fe1e-4e50-89d6-5ab96f7e0a18 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.666014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eab8f6-61ef-4dfa-bc77-bd66b818a9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.666683 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eab8f6-61ef-4dfa-bc77-bd66b818a9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.666960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eab8f6-61ef-4dfa-bc77-bd66b818a9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.667234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eab8f6-61ef-4dfa-bc77-bd66b818a9a1 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.669120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eab8f6-61ef-4dfa-bc77-bd66b818a9a1 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.670581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eab8f6-61ef-4dfa-bc77-bd66b818a9a1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.672506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 200/406] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:48.673273 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eab8f6-61ef-4dfa-bc77-bd66b818a9a1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.686375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033a728-2800-4c5a-8cee-b1bef1aeaa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.687022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a728-2800-4c5a-8cee-b1bef1aeaa34 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.687310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a728-2800-4c5a-8cee-b1bef1aeaa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.687594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a728-2800-4c5a-8cee-b1bef1aeaa34 None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.688700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033a728-2800-4c5a-8cee-b1bef1aeaa34 None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.690841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033a728-2800-4c5a-8cee-b1bef1aeaa34 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.693072 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 207/407] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:48.694250 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176de34-dd0c-4bb3-bfc6-de4157ec3450 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.694603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176de34-dd0c-4bb3-bfc6-de4157ec3450 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.694883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176de34-dd0c-4bb3-bfc6-de4157ec3450 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.696156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 208/408] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:48.696838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176de34-dd0c-4bb3-bfc6-de4157ec3450 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.735158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.787130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eab8f6-61ef-4dfa-bc77-bd66b818a9a1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.795778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.806744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176de34-dd0c-4bb3-bfc6-de4157ec3450 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.824417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae28da9-67b9-4445-b3b9-59d84c8d263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.825065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae28da9-67b9-4445-b3b9-59d84c8d263d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.825337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae28da9-67b9-4445-b3b9-59d84c8d263d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.825615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae28da9-67b9-4445-b3b9-59d84c8d263d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.836658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae28da9-67b9-4445-b3b9-59d84c8d263d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-bae28da9-67b9-4445-b3b9-59d84c8d263d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:48.841863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:48.843009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:48.843842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 201/409] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:48.844503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a579546-95ee-444c-a1ed-2a4afea408e5 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.844770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a579546-95ee-444c-a1ed-2a4afea408e5 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.845046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a579546-95ee-444c-a1ed-2a4afea408e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.850581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0be29-337a-44dd-9398-e5667247dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.851584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0be29-337a-44dd-9398-e5667247dad0 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.852104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0be29-337a-44dd-9398-e5667247dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.852717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0be29-337a-44dd-9398-e5667247dad0 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/groups/ba14b31496534ffa84ddf7201297e04d/roles/60c41aabe4694d07bf0b66f5223c3d0d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.854985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0be29-337a-44dd-9398-e5667247dad0 None admin] RBAC: Authorizing `identity:create_grant(project_id=73350d92b0dd475bbfeeb9bf45131a54, group_id=ba14b31496534ffa84ddf7201297e04d, role_id=60c41aabe4694d07bf0b66f5223c3d0d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.856520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0be29-337a-44dd-9398-e5667247dad0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.863464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-8a579546-95ee-444c-a1ed-2a4afea408e5 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:48.865221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8a579546-95ee-444c-a1ed-2a4afea408e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:48.932169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 202/410] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:48.932930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a579546-95ee-444c-a1ed-2a4afea408e5 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.958959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 209/411] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 22 12:26:48 2022] PUT /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54/groups/ba14b31496534ffa84ddf7201297e04d/roles/60c41aabe4694d07bf0b66f5223c3d0d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:48.960248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0be29-337a-44dd-9398-e5667247dad0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.017927 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.128752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a579546-95ee-444c-a1ed-2a4afea408e5 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.159336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0be29-337a-44dd-9398-e5667247dad0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.165422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b421ff7-f489-42b6-ac91-1eec06f84b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.166073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b421ff7-f489-42b6-ac91-1eec06f84b63 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.166388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b421ff7-f489-42b6-ac91-1eec06f84b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.166669 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b421ff7-f489-42b6-ac91-1eec06f84b63 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.167812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b421ff7-f489-42b6-ac91-1eec06f84b63 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.169253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b421ff7-f489-42b6-ac91-1eec06f84b63 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.178724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 203/412] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:49.187298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b421ff7-f489-42b6-ac91-1eec06f84b63 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.201477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21138a-4169-4285-a945-3ed8ba039304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.202222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21138a-4169-4285-a945-3ed8ba039304 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.202514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21138a-4169-4285-a945-3ed8ba039304 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.202787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21138a-4169-4285-a945-3ed8ba039304 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.203458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21138a-4169-4285-a945-3ed8ba039304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:49.203761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21138a-4169-4285-a945-3ed8ba039304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.206087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21138a-4169-4285-a945-3ed8ba039304 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.219692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 210/413] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:49.225591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21138a-4169-4285-a945-3ed8ba039304 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.242099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.331696 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b421ff7-f489-42b6-ac91-1eec06f84b63 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.339744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21138a-4169-4285-a945-3ed8ba039304 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.350032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.376179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b8030-e8a9-45b1-a1a9-a968d7da60b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.377273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b8030-e8a9-45b1-a1a9-a968d7da60b0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.377660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b8030-e8a9-45b1-a1a9-a968d7da60b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.378007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1aebf2-562f-46e8-98f7-76b5d9769915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.378158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b8030-e8a9-45b1-a1a9-a968d7da60b0 None admin] PATH_INFO: `/v3/groups/5d56458356cc43f0b4a354129841e6c2` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.379023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1aebf2-562f-46e8-98f7-76b5d9769915 None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.379445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1aebf2-562f-46e8-98f7-76b5d9769915 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.379639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b8030-e8a9-45b1-a1a9-a968d7da60b0 None admin] RBAC: Authorizing `identity:get_group(group_id=5d56458356cc43f0b4a354129841e6c2)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.380528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1aebf2-562f-46e8-98f7-76b5d9769915 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/groups/ba14b31496534ffa84ddf7201297e04d/roles/60c41aabe4694d07bf0b66f5223c3d0d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.381937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b8030-e8a9-45b1-a1a9-a968d7da60b0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.383108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1aebf2-562f-46e8-98f7-76b5d9769915 None admin] RBAC: Authorizing `identity:create_grant(project_id=e608f657ec954895ae35c7bd1b8fa6ea, group_id=ba14b31496534ffa84ddf7201297e04d, role_id=60c41aabe4694d07bf0b66f5223c3d0d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.383894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 211/414] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:49 2022] GET /identity/v3/groups/5d56458356cc43f0b4a354129841e6c2 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:49.384750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b8030-e8a9-45b1-a1a9-a968d7da60b0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.385084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1aebf2-562f-46e8-98f7-76b5d9769915 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.465530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 204/415] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 22 12:26:49 2022] PUT /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea/groups/ba14b31496534ffa84ddf7201297e04d/roles/60c41aabe4694d07bf0b66f5223c3d0d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:49.467588 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1aebf2-562f-46e8-98f7-76b5d9769915 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.479141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.521959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b8030-e8a9-45b1-a1a9-a968d7da60b0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.572143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db0f89-ce9c-412c-abaf-96f9f8790524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.572819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db0f89-ce9c-412c-abaf-96f9f8790524 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.573105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db0f89-ce9c-412c-abaf-96f9f8790524 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.573383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db0f89-ce9c-412c-abaf-96f9f8790524 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.596444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db0f89-ce9c-412c-abaf-96f9f8790524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b3db0f89-ce9c-412c-abaf-96f9f8790524 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:49.602427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:49.603406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:49.604236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:49.611494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 212/416] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:49.615700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db0f89-ce9c-412c-abaf-96f9f8790524 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.669359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1aebf2-562f-46e8-98f7-76b5d9769915 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.715735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4af28-c730-4171-996d-9c8c715e5003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.717100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4af28-c730-4171-996d-9c8c715e5003 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.718052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4af28-c730-4171-996d-9c8c715e5003 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.718880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4af28-c730-4171-996d-9c8c715e5003 None admin] PATH_INFO: `/v3/projects/6699bdfe1f6a452e99cfdff2e04fc5e9` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.720316 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4af28-c730-4171-996d-9c8c715e5003 None admin] RBAC: Authorizing `identity:get_project(project_id=6699bdfe1f6a452e99cfdff2e04fc5e9)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.722314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4af28-c730-4171-996d-9c8c715e5003 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.725825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 205/417] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:49 2022] GET /identity/v3/projects/6699bdfe1f6a452e99cfdff2e04fc5e9 => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:49.735264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4af28-c730-4171-996d-9c8c715e5003 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.781811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db0f89-ce9c-412c-abaf-96f9f8790524 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.809490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.844499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a1f7f-1d46-4f81-87ab-45869d822ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.845194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1f7f-1d46-4f81-87ab-45869d822ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.845482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1f7f-1d46-4f81-87ab-45869d822ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.845764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1f7f-1d46-4f81-87ab-45869d822ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.846471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a1f7f-1d46-4f81-87ab-45869d822ef0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:49.846788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a1f7f-1d46-4f81-87ab-45869d822ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.848197 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a1f7f-1d46-4f81-87ab-45869d822ef0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.867102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 213/418] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:49.879086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a1f7f-1d46-4f81-87ab-45869d822ef0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.884660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.927518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4af28-c730-4171-996d-9c8c715e5003 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.997854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cb06a-6d04-4b33-ba19-a71302b2f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.998468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cb06a-6d04-4b33-ba19-a71302b2f67d None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.998749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cb06a-6d04-4b33-ba19-a71302b2f67d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.999024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cb06a-6d04-4b33-ba19-a71302b2f67d None admin] PATH_INFO: `/v3/projects/6699bdfe1f6a452e99cfdff2e04fc5e9/groups/5d56458356cc43f0b4a354129841e6c2/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.002153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cb06a-6d04-4b33-ba19-a71302b2f67d None admin] RBAC: Authorizing `identity:create_grant(project_id=6699bdfe1f6a452e99cfdff2e04fc5e9, group_id=5d56458356cc43f0b4a354129841e6c2, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:50.003886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cb06a-6d04-4b33-ba19-a71302b2f67d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:50.050851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a1f7f-1d46-4f81-87ab-45869d822ef0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:50.085550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 206/419] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 22 12:26:49 2022] PUT /identity/v3/projects/6699bdfe1f6a452e99cfdff2e04fc5e9/groups/5d56458356cc43f0b4a354129841e6c2/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:50.103647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514f98a-0173-444d-8cff-1167ef5a8ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:50.104846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514f98a-0173-444d-8cff-1167ef5a8ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.105312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514f98a-0173-444d-8cff-1167ef5a8ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.105641 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514f98a-0173-444d-8cff-1167ef5a8ef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.212671 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514f98a-0173-444d-8cff-1167ef5a8ef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:50.214239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514f98a-0173-444d-8cff-1167ef5a8ef4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:50.218572 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:50.354920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 214/420] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:50.360368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cb06a-6d04-4b33-ba19-a71302b2f67d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:50.474547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:50.478655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cb06a-6d04-4b33-ba19-a71302b2f67d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:50.515514 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90076493-289d-4d44-8222-ac0b081852d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:50.516541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076493-289d-4d44-8222-ac0b081852d8 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.517027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076493-289d-4d44-8222-ac0b081852d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.517501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076493-289d-4d44-8222-ac0b081852d8 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.521730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90076493-289d-4d44-8222-ac0b081852d8 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:50.523623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90076493-289d-4d44-8222-ac0b081852d8 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:50.525613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 207/421] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:50 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:50.532040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514f98a-0173-444d-8cff-1167ef5a8ef4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:50.657607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514f98a-0173-444d-8cff-1167ef5a8ef4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:50.670745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:50.697515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e135b-89f0-4b31-ad9f-29634e7107b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:50.698444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e135b-89f0-4b31-ad9f-29634e7107b2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.698834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e135b-89f0-4b31-ad9f-29634e7107b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.699277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e135b-89f0-4b31-ad9f-29634e7107b2 None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.700555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e135b-89f0-4b31-ad9f-29634e7107b2 None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:50.702126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e135b-89f0-4b31-ad9f-29634e7107b2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:50.704336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 215/422] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:50 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:50.710808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90076493-289d-4d44-8222-ac0b081852d8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:50.733898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425aa5b-6880-48ae-b754-da2603a52412 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.734338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425aa5b-6880-48ae-b754-da2603a52412 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.734622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425aa5b-6880-48ae-b754-da2603a52412 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.735972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 216/423] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:50.742308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772c443-af58-4a56-abaf-0acfef8e434d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.742648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772c443-af58-4a56-abaf-0acfef8e434d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.742935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772c443-af58-4a56-abaf-0acfef8e434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.776988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e772c443-af58-4a56-abaf-0acfef8e434d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:50.778250 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e772c443-af58-4a56-abaf-0acfef8e434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:50.881126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 217/424] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:50.928994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90076493-289d-4d44-8222-ac0b081852d8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:50.972950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecd486-d84d-4a1e-81f6-849196a2294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:50.973584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecd486-d84d-4a1e-81f6-849196a2294d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.973859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecd486-d84d-4a1e-81f6-849196a2294d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.974130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecd486-d84d-4a1e-81f6-849196a2294d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.975060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecd486-d84d-4a1e-81f6-849196a2294d None admin] RBAC: Adding query filter params (group.id=ba14b31496534ffa84ddf7201297e04d, role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:50.975369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecd486-d84d-4a1e-81f6-849196a2294d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:50.976798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecd486-d84d-4a1e-81f6-849196a2294d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:50.982579 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 208/425] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:50 2022] GET /identity/v3/role_assignments?group.id=ba14b31496534ffa84ddf7201297e04d&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 611 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:51.244680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772c443-af58-4a56-abaf-0acfef8e434d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.306895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47ffbf-506c-43c1-8ba3-a78eb47d65e1 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.307218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47ffbf-506c-43c1-8ba3-a78eb47d65e1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.307437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47ffbf-506c-43c1-8ba3-a78eb47d65e1 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.309061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 209/426] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:51.315653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e8a5b-6069-49bb-a527-4d933ea1c116 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.315931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e8a5b-6069-49bb-a527-4d933ea1c116 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.316201 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e8a5b-6069-49bb-a527-4d933ea1c116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.336015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-985e8a5b-6069-49bb-a527-4d933ea1c116 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:51.337250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-985e8a5b-6069-49bb-a527-4d933ea1c116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:51.353749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:51.359671 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772c443-af58-4a56-abaf-0acfef8e434d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:51.373204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:51.403076 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37361-6941-4d6b-ae60-949a7a205e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:51.403727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37361-6941-4d6b-ae60-949a7a205e93 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.404019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37361-6941-4d6b-ae60-949a7a205e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.404305 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37361-6941-4d6b-ae60-949a7a205e93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.418784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e37361-6941-4d6b-ae60-949a7a205e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-a6e37361-6941-4d6b-ae60-949a7a205e93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:51.425298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:51.426205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:51.427634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:51.429992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 218/427] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:51.430695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 210/428] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:51.436287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37361-6941-4d6b-ae60-949a7a205e93 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.549948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37361-6941-4d6b-ae60-949a7a205e93 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:51.586093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e1d04-279b-4a8d-8740-c65150994311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:51.586991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e1d04-279b-4a8d-8740-c65150994311 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.587414 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e1d04-279b-4a8d-8740-c65150994311 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.587832 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e1d04-279b-4a8d-8740-c65150994311 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.588635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e1d04-279b-4a8d-8740-c65150994311 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:51.589077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e1d04-279b-4a8d-8740-c65150994311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:51.590652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e1d04-279b-4a8d-8740-c65150994311 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:51.600179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 219/429] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:51.605583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e8a5b-6069-49bb-a527-4d933ea1c116 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.718811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e8a5b-6069-49bb-a527-4d933ea1c116 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:51.741906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e1d04-279b-4a8d-8740-c65150994311 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.758850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532c54e-9f8f-4827-a396-a6bef88a8675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:51.759481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c54e-9f8f-4827-a396-a6bef88a8675 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.759973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c54e-9f8f-4827-a396-a6bef88a8675 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.760078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c54e-9f8f-4827-a396-a6bef88a8675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.774653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:51.794171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:51.839094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532c54e-9f8f-4827-a396-a6bef88a8675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:51.840783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532c54e-9f8f-4827-a396-a6bef88a8675 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:51.869397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e1d04-279b-4a8d-8740-c65150994311 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:51.906276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbcbeb-0826-48aa-abb0-2fa4b6ae742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:51.907307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbcbeb-0826-48aa-abb0-2fa4b6ae742d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.907791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbcbeb-0826-48aa-abb0-2fa4b6ae742d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.908256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbcbeb-0826-48aa-abb0-2fa4b6ae742d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.922797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbcbeb-0826-48aa-abb0-2fa4b6ae742d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-4bfbcbeb-0826-48aa-abb0-2fa4b6ae742d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:51.930306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:51.931247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:51.932069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:51.934230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 220/430] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:51.936030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6ce13-15b7-4d5f-becd-aa85936b5941 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.936558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6ce13-15b7-4d5f-becd-aa85936b5941 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.936972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6ce13-15b7-4d5f-becd-aa85936b5941 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.939070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 221/431] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:51.939956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6ce13-15b7-4d5f-becd-aa85936b5941 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.956104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 211/432] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:51.957396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db1533-b217-4502-8da4-0dd920b7a932 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.957718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db1533-b217-4502-8da4-0dd920b7a932 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.958613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db1533-b217-4502-8da4-0dd920b7a932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.978375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-f6db1533-b217-4502-8da4-0dd920b7a932 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:51.979576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f6db1533-b217-4502-8da4-0dd920b7a932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:52.048386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.053400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.063913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 212/433] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:52.064653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db1533-b217-4502-8da4-0dd920b7a932 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.075891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6ce13-15b7-4d5f-becd-aa85936b5941 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.120726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4cc8c-49f4-460a-9fe3-11860a8be696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.121719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4cc8c-49f4-460a-9fe3-11860a8be696 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.122483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4cc8c-49f4-460a-9fe3-11860a8be696 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.122731 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4cc8c-49f4-460a-9fe3-11860a8be696 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.123417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4cc8c-49f4-460a-9fe3-11860a8be696 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:52.123731 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4cc8c-49f4-460a-9fe3-11860a8be696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.125129 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4cc8c-49f4-460a-9fe3-11860a8be696 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.133579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 222/434] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:52.139435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4cc8c-49f4-460a-9fe3-11860a8be696 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.183932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db1533-b217-4502-8da4-0dd920b7a932 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.226860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1c8d5-4f70-45ad-b369-ca1d81bd4554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.227669 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1c8d5-4f70-45ad-b369-ca1d81bd4554 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.228455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1c8d5-4f70-45ad-b369-ca1d81bd4554 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.228842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1c8d5-4f70-45ad-b369-ca1d81bd4554 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.230087 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1c8d5-4f70-45ad-b369-ca1d81bd4554 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.232345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1c8d5-4f70-45ad-b369-ca1d81bd4554 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.234381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 213/435] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:52.240261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1c8d5-4f70-45ad-b369-ca1d81bd4554 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.263056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4cc8c-49f4-460a-9fe3-11860a8be696 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.300278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.304555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31925146-d7a7-4821-bd6f-d0107cc2fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.305426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31925146-d7a7-4821-bd6f-d0107cc2fcbf None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.305886 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31925146-d7a7-4821-bd6f-d0107cc2fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.306462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31925146-d7a7-4821-bd6f-d0107cc2fcbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.323509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.344434 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1c8d5-4f70-45ad-b369-ca1d81bd4554 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.383415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31925146-d7a7-4821-bd6f-d0107cc2fcbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.384804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31925146-d7a7-4821-bd6f-d0107cc2fcbf None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.385172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff38a1-ec14-452e-bbef-8a7b53dfcaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.386383 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff38a1-ec14-452e-bbef-8a7b53dfcaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.386835 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff38a1-ec14-452e-bbef-8a7b53dfcaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.387287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff38a1-ec14-452e-bbef-8a7b53dfcaf5 None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.388579 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff38a1-ec14-452e-bbef-8a7b53dfcaf5 None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.390176 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff38a1-ec14-452e-bbef-8a7b53dfcaf5 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.392392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 214/436] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:52.393294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff38a1-ec14-452e-bbef-8a7b53dfcaf5 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.497529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 223/437] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:52.498493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31925146-d7a7-4821-bd6f-d0107cc2fcbf None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.511133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff38a1-ec14-452e-bbef-8a7b53dfcaf5 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.540824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.548977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.550225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd8145-fef0-44e9-9c55-1c5d62c5caf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.550885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd8145-fef0-44e9-9c55-1c5d62c5caf1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.551168 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd8145-fef0-44e9-9c55-1c5d62c5caf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.551483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd8145-fef0-44e9-9c55-1c5d62c5caf1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.562525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd8145-fef0-44e9-9c55-1c5d62c5caf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-53dd8145-fef0-44e9-9c55-1c5d62c5caf1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:52.568254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:52.569150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:52.569971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 215/438] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:52.570681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd8145-fef0-44e9-9c55-1c5d62c5caf1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.609421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31925146-d7a7-4821-bd6f-d0107cc2fcbf None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.642505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a634798-40ec-4191-8b67-9e1cc9d4dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.643049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a634798-40ec-4191-8b67-9e1cc9d4dd87 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.643326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a634798-40ec-4191-8b67-9e1cc9d4dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.643607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a634798-40ec-4191-8b67-9e1cc9d4dd87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.644331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a634798-40ec-4191-8b67-9e1cc9d4dd87 None admin] RBAC: Adding query filter params (group.id=ba14b31496534ffa84ddf7201297e04d, role.id=a09ff6a1ba5641ff96d63b8109bf1f7e, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:52.644644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a634798-40ec-4191-8b67-9e1cc9d4dd87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.646221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a634798-40ec-4191-8b67-9e1cc9d4dd87 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.651860 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 224/439] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/role_assignments?group.id=ba14b31496534ffa84ddf7201297e04d&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=a09ff6a1ba5641ff96d63b8109bf1f7e => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:52.653027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173512a-3fa0-46e5-8dea-9a16acb3bf00 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.653311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173512a-3fa0-46e5-8dea-9a16acb3bf00 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.653593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173512a-3fa0-46e5-8dea-9a16acb3bf00 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.654834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 225/440] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:52.655553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173512a-3fa0-46e5-8dea-9a16acb3bf00 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.681017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd8145-fef0-44e9-9c55-1c5d62c5caf1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.720392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489ecda-87df-4b3f-bd32-d1f3ddda7875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.721044 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489ecda-87df-4b3f-bd32-d1f3ddda7875 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.721331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489ecda-87df-4b3f-bd32-d1f3ddda7875 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.721638 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489ecda-87df-4b3f-bd32-d1f3ddda7875 None admin] PATH_INFO: `/v3/projects/73350d92b0dd475bbfeeb9bf45131a54` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.722826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489ecda-87df-4b3f-bd32-d1f3ddda7875 None admin] RBAC: Authorizing `identity:get_project(project_id=73350d92b0dd475bbfeeb9bf45131a54)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.724943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489ecda-87df-4b3f-bd32-d1f3ddda7875 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.726870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 216/441] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/projects/73350d92b0dd475bbfeeb9bf45131a54 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:52.731776 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e514ba-2057-4937-b442-82eb94b3ef0c None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.732061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e514ba-2057-4937-b442-82eb94b3ef0c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.732340 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e514ba-2057-4937-b442-82eb94b3ef0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.750743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-b2e514ba-2057-4937-b442-82eb94b3ef0c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:52.751981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b2e514ba-2057-4937-b442-82eb94b3ef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:52.780196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173512a-3fa0-46e5-8dea-9a16acb3bf00 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.791198 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.810816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.818762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38925-9c9b-48a8-8cf4-8bc4991b2bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.819396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38925-9c9b-48a8-8cf4-8bc4991b2bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.819677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38925-9c9b-48a8-8cf4-8bc4991b2bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.819951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38925-9c9b-48a8-8cf4-8bc4991b2bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.820626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38925-9c9b-48a8-8cf4-8bc4991b2bc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:52.821898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38925-9c9b-48a8-8cf4-8bc4991b2bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.823367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38925-9c9b-48a8-8cf4-8bc4991b2bc8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.832329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 217/442] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:52.833127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 226/443] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:52.833678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e514ba-2057-4937-b442-82eb94b3ef0c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.839191 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38925-9c9b-48a8-8cf4-8bc4991b2bc8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.959738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38925-9c9b-48a8-8cf4-8bc4991b2bc8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.966387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e514ba-2057-4937-b442-82eb94b3ef0c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.995762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a811333-627b-40f8-9bf4-236390967b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.996378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a811333-627b-40f8-9bf4-236390967b9a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.996655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a811333-627b-40f8-9bf4-236390967b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.996933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a811333-627b-40f8-9bf4-236390967b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.008468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14c00-d249-46b5-addd-fbbc4ea5f3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.009099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14c00-d249-46b5-addd-fbbc4ea5f3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.009383 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14c00-d249-46b5-addd-fbbc4ea5f3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.009660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14c00-d249-46b5-addd-fbbc4ea5f3c1 None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.010785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab14c00-d249-46b5-addd-fbbc4ea5f3c1 None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.012229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab14c00-d249-46b5-addd-fbbc4ea5f3c1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.013791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 218/444] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:53.019478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14c00-d249-46b5-addd-fbbc4ea5f3c1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.039644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.068285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a811333-627b-40f8-9bf4-236390967b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.070141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a811333-627b-40f8-9bf4-236390967b9a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.078755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.130497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14c00-d249-46b5-addd-fbbc4ea5f3c1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.164134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d85085-8bd3-4e3d-8676-bc61c617c5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.164727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d85085-8bd3-4e3d-8676-bc61c617c5dd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.165004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d85085-8bd3-4e3d-8676-bc61c617c5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.165275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d85085-8bd3-4e3d-8676-bc61c617c5dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.165990 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d85085-8bd3-4e3d-8676-bc61c617c5dd None admin] RBAC: Adding query filter params (group.id=ba14b31496534ffa84ddf7201297e04d, role.id=60c41aabe4694d07bf0b66f5223c3d0d, scope.project.id=73350d92b0dd475bbfeeb9bf45131a54) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:53.166330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d85085-8bd3-4e3d-8676-bc61c617c5dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.167750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d85085-8bd3-4e3d-8676-bc61c617c5dd None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.178291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 227/445] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:53.178291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a811333-627b-40f8-9bf4-236390967b9a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.178658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 219/446] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/role_assignments?group.id=ba14b31496534ffa84ddf7201297e04d&scope.project.id=73350d92b0dd475bbfeeb9bf45131a54&role.id=60c41aabe4694d07bf0b66f5223c3d0d => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:53.180294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d85085-8bd3-4e3d-8676-bc61c617c5dd None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.263003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.297204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a811333-627b-40f8-9bf4-236390967b9a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.298926 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d85085-8bd3-4e3d-8676-bc61c617c5dd None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.321167 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.341443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad667e8-7027-4487-96f9-6edb923574c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.342052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad667e8-7027-4487-96f9-6edb923574c1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.342386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad667e8-7027-4487-96f9-6edb923574c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.342667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad667e8-7027-4487-96f9-6edb923574c1 None admin] PATH_INFO: `/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.343008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6472d5-ab3e-4f73-a2e7-056a523dff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.343651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6472d5-ab3e-4f73-a2e7-056a523dff85 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.343811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad667e8-7027-4487-96f9-6edb923574c1 None admin] RBAC: Authorizing `identity:get_project(project_id=e608f657ec954895ae35c7bd1b8fa6ea)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.343964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6472d5-ab3e-4f73-a2e7-056a523dff85 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.344268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6472d5-ab3e-4f73-a2e7-056a523dff85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.345305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad667e8-7027-4487-96f9-6edb923574c1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.347149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 220/447] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/projects/e608f657ec954895ae35c7bd1b8fa6ea => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:53.353444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad667e8-7027-4487-96f9-6edb923574c1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.357319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6472d5-ab3e-4f73-a2e7-056a523dff85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6f6472d5-ab3e-4f73-a2e7-056a523dff85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:53.363461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:53.364979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:53.365799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 228/448] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:53.370824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6472d5-ab3e-4f73-a2e7-056a523dff85 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.459109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad667e8-7027-4487-96f9-6edb923574c1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.470958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6472d5-ab3e-4f73-a2e7-056a523dff85 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.492576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e6606-f48a-4b93-bd3a-6a9deab44f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.493204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e6606-f48a-4b93-bd3a-6a9deab44f7c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.493486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e6606-f48a-4b93-bd3a-6a9deab44f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.493795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e6606-f48a-4b93-bd3a-6a9deab44f7c None admin] PATH_INFO: `/v3/groups/ba14b31496534ffa84ddf7201297e04d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.494920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e6606-f48a-4b93-bd3a-6a9deab44f7c None admin] RBAC: Authorizing `identity:get_group(group_id=ba14b31496534ffa84ddf7201297e04d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.496364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e6606-f48a-4b93-bd3a-6a9deab44f7c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.497917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 221/449] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/groups/ba14b31496534ffa84ddf7201297e04d => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:53.498928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.503565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e6606-f48a-4b93-bd3a-6a9deab44f7c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.505437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d343e-8465-4fc5-a3f5-ac9b298b8e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.506097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d343e-8465-4fc5-a3f5-ac9b298b8e70 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.506411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d343e-8465-4fc5-a3f5-ac9b298b8e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.506816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d343e-8465-4fc5-a3f5-ac9b298b8e70 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.507556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d343e-8465-4fc5-a3f5-ac9b298b8e70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:53.507866 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d343e-8465-4fc5-a3f5-ac9b298b8e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.509266 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d343e-8465-4fc5-a3f5-ac9b298b8e70 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.517972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 229/450] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:53.523946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d343e-8465-4fc5-a3f5-ac9b298b8e70 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.559612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.603238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e6606-f48a-4b93-bd3a-6a9deab44f7c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.621592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d343e-8465-4fc5-a3f5-ac9b298b8e70 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.638144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916bc65-fbf5-473b-92ca-6d8ac5bf2a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.638781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916bc65-fbf5-473b-92ca-6d8ac5bf2a99 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.639059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916bc65-fbf5-473b-92ca-6d8ac5bf2a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.639329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916bc65-fbf5-473b-92ca-6d8ac5bf2a99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.640045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916bc65-fbf5-473b-92ca-6d8ac5bf2a99 None admin] RBAC: Adding query filter params (group.id=ba14b31496534ffa84ddf7201297e04d, role.id=60c41aabe4694d07bf0b66f5223c3d0d, scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:53.640353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916bc65-fbf5-473b-92ca-6d8ac5bf2a99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.641804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916bc65-fbf5-473b-92ca-6d8ac5bf2a99 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.647784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 222/451] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/role_assignments?group.id=ba14b31496534ffa84ddf7201297e04d&scope.project.id=e608f657ec954895ae35c7bd1b8fa6ea&role.id=60c41aabe4694d07bf0b66f5223c3d0d => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:53.654873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce6bd4-a41f-4e45-b7bb-d6fd675b20d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.655509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6bd4-a41f-4e45-b7bb-d6fd675b20d2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.655792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6bd4-a41f-4e45-b7bb-d6fd675b20d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.656066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6bd4-a41f-4e45-b7bb-d6fd675b20d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.720842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.731167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce6bd4-a41f-4e45-b7bb-d6fd675b20d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.732664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce6bd4-a41f-4e45-b7bb-d6fd675b20d2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.836691 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 230/452] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:26:53.842676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916bc65-fbf5-473b-92ca-6d8ac5bf2a99 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.947027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916bc65-fbf5-473b-92ca-6d8ac5bf2a99 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.963994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.981299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5124b-5ac4-4320-8f01-bddc7a11f20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.981978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5124b-5ac4-4320-8f01-bddc7a11f20d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.982348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5124b-5ac4-4320-8f01-bddc7a11f20d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.982632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5124b-5ac4-4320-8f01-bddc7a11f20d None admin] PATH_INFO: `/v3/projects/6699bdfe1f6a452e99cfdff2e04fc5e9` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.983758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5124b-5ac4-4320-8f01-bddc7a11f20d None admin] RBAC: Authorizing `identity:get_project(project_id=6699bdfe1f6a452e99cfdff2e04fc5e9)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.985265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5124b-5ac4-4320-8f01-bddc7a11f20d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.987088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 223/453] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/projects/6699bdfe1f6a452e99cfdff2e04fc5e9 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:53.992891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce6bd4-a41f-4e45-b7bb-d6fd675b20d2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:54.086396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:54.096297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce6bd4-a41f-4e45-b7bb-d6fd675b20d2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:54.131834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f250e-1295-42fe-b42c-4ac8b10cb25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:54.132466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f250e-1295-42fe-b42c-4ac8b10cb25b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:54.132747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f250e-1295-42fe-b42c-4ac8b10cb25b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:54.133024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f250e-1295-42fe-b42c-4ac8b10cb25b None admin] PATH_INFO: `/v3/groups/5d56458356cc43f0b4a354129841e6c2` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:54.134123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f250e-1295-42fe-b42c-4ac8b10cb25b None admin] RBAC: Authorizing `identity:get_group(group_id=5d56458356cc43f0b4a354129841e6c2)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:54.135601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f250e-1295-42fe-b42c-4ac8b10cb25b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:54.137157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 231/454] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/groups/5d56458356cc43f0b4a354129841e6c2 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:54.142975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5124b-5ac4-4320-8f01-bddc7a11f20d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:54.248729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5124b-5ac4-4320-8f01-bddc7a11f20d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:54.282288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890c95e-714b-4b25-8631-469cf4cb892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:54.282884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890c95e-714b-4b25-8631-469cf4cb892f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:54.283160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890c95e-714b-4b25-8631-469cf4cb892f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:54.283427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890c95e-714b-4b25-8631-469cf4cb892f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:54.284137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890c95e-714b-4b25-8631-469cf4cb892f None admin] RBAC: Adding query filter params (group.id=5d56458356cc43f0b4a354129841e6c2, role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=6699bdfe1f6a452e99cfdff2e04fc5e9) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:54.284439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890c95e-714b-4b25-8631-469cf4cb892f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:54.286455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890c95e-714b-4b25-8631-469cf4cb892f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:54.292071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 224/455] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:54 2022] GET /identity/v3/role_assignments?group.id=5d56458356cc43f0b4a354129841e6c2&scope.project.id=6699bdfe1f6a452e99cfdff2e04fc5e9&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:56.510375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32da9e-96f3-4e08-9db0-9e879a60839b None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.510852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32da9e-96f3-4e08-9db0-9e879a60839b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.510852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32da9e-96f3-4e08-9db0-9e879a60839b None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.512448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 232/456] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:56.518543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f896c6b-83db-46b1-b81a-0f1016a58617 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.519435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f896c6b-83db-46b1-b81a-0f1016a58617 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.519913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f896c6b-83db-46b1-b81a-0f1016a58617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.542652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-2f896c6b-83db-46b1-b81a-0f1016a58617 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:56.544234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2f896c6b-83db-46b1-b81a-0f1016a58617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:56.602417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:56.632668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 225/457] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:56.813397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a873-577c-4576-8171-5b8939a95df8 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.813779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a873-577c-4576-8171-5b8939a95df8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.813982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a873-577c-4576-8171-5b8939a95df8 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.815814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 233/458] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:56.821129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9988dc-bc1d-4454-8353-f1172ca43257 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.821416 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9988dc-bc1d-4454-8353-f1172ca43257 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.821691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9988dc-bc1d-4454-8353-f1172ca43257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.847129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1c9988dc-bc1d-4454-8353-f1172ca43257 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:56.848415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1c9988dc-bc1d-4454-8353-f1172ca43257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:56.936097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64a873-577c-4576-8171-5b8939a95df8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:56.938273 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 226/459] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:57.102958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64a873-577c-4576-8171-5b8939a95df8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.147749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c88c0d-ed38-407b-8474-1125688c5fea None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.148066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c88c0d-ed38-407b-8474-1125688c5fea None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.148315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c88c0d-ed38-407b-8474-1125688c5fea None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.150054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34d68c-0fd0-4d53-8559-bbca3a81cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.150712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34d68c-0fd0-4d53-8559-bbca3a81cc4b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.150919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 227/460] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:57.151020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34d68c-0fd0-4d53-8559-bbca3a81cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.151247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34d68c-0fd0-4d53-8559-bbca3a81cc4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.154986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabe0f1-0cef-4c90-99f4-704caf0091d9 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.155361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabe0f1-0cef-4c90-99f4-704caf0091d9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.155536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabe0f1-0cef-4c90-99f4-704caf0091d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.165475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34d68c-0fd0-4d53-8559-bbca3a81cc4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.168487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34d68c-0fd0-4d53-8559-bbca3a81cc4b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.188175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-faabe0f1-0cef-4c90-99f4-704caf0091d9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:57.189366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-faabe0f1-0cef-4c90-99f4-704caf0091d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-0f34d68c-0fd0-4d53-8559-bbca3a81cc4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:26:57.197652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:57.198604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:26:57.199482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:26:57.199482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:57.199482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:57.199482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 234/461] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:57.206432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34d68c-0fd0-4d53-8559-bbca3a81cc4b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.234945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.287185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 228/462] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:57.288158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabe0f1-0cef-4c90-99f4-704caf0091d9 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.337734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34d68c-0fd0-4d53-8559-bbca3a81cc4b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.340509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.389867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdade609-74f8-42a8-b7c2-9bc5451f164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.391101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade609-74f8-42a8-b7c2-9bc5451f164a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.392037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade609-74f8-42a8-b7c2-9bc5451f164a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.392512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade609-74f8-42a8-b7c2-9bc5451f164a None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.393360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdade609-74f8-42a8-b7c2-9bc5451f164a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:57.393847 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdade609-74f8-42a8-b7c2-9bc5451f164a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.396782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdade609-74f8-42a8-b7c2-9bc5451f164a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.409159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabe0f1-0cef-4c90-99f4-704caf0091d9 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.421962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 235/463] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:57.423562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08728d-93d8-4b67-87bf-0a89ab6584b8 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.424045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08728d-93d8-4b67-87bf-0a89ab6584b8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.424494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08728d-93d8-4b67-87bf-0a89ab6584b8 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.425894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 236/464] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:57.427996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08728d-93d8-4b67-87bf-0a89ab6584b8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.459603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfc6c5-c8e8-4dd5-98c6-c31771881fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.460839 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfc6c5-c8e8-4dd5-98c6-c31771881fbc None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.461357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfc6c5-c8e8-4dd5-98c6-c31771881fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.462174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfc6c5-c8e8-4dd5-98c6-c31771881fbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.476970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfc6c5-c8e8-4dd5-98c6-c31771881fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.479234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfc6c5-c8e8-4dd5-98c6-c31771881fbc None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-ebdfc6c5-c8e8-4dd5-98c6-c31771881fbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:26:57.501854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:57.502843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:26:57.503781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:26:57.503781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:57.503781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:57.506107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 229/465] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:57.512550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a59fe-1fe0-4474-8936-7a2f0b5aacec None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.512834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a59fe-1fe0-4474-8936-7a2f0b5aacec None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.513106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a59fe-1fe0-4474-8936-7a2f0b5aacec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.524759 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.531970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-479a59fe-1fe0-4474-8936-7a2f0b5aacec None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:57.533170 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-479a59fe-1fe0-4474-8936-7a2f0b5aacec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:57.567911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08728d-93d8-4b67-87bf-0a89ab6584b8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.602646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85defa-ddd4-4dff-b37a-95967f78ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.603251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85defa-ddd4-4dff-b37a-95967f78ef08 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.603535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85defa-ddd4-4dff-b37a-95967f78ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.603812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85defa-ddd4-4dff-b37a-95967f78ef08 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.604451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85defa-ddd4-4dff-b37a-95967f78ef08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.610379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 230/466] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:57.610379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a59fe-1fe0-4474-8936-7a2f0b5aacec None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.610599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85defa-ddd4-4dff-b37a-95967f78ef08 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.634025 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.709123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a59fe-1fe0-4474-8936-7a2f0b5aacec None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.729875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 237/467] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:57 2022] POST /identity/v3/users => generated 246 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:26:57.729875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85defa-ddd4-4dff-b37a-95967f78ef08 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.765844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189616e-3f1e-4a74-80cd-1dbe2a32198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.766772 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189616e-3f1e-4a74-80cd-1dbe2a32198f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.767202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189616e-3f1e-4a74-80cd-1dbe2a32198f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.767650 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189616e-3f1e-4a74-80cd-1dbe2a32198f None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.770803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189616e-3f1e-4a74-80cd-1dbe2a32198f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:57.771289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189616e-3f1e-4a74-80cd-1dbe2a32198f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.773786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189616e-3f1e-4a74-80cd-1dbe2a32198f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.806459 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 231/468] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:57.808818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189616e-3f1e-4a74-80cd-1dbe2a32198f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.932420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.933960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85defa-ddd4-4dff-b37a-95967f78ef08 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.953256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189616e-3f1e-4a74-80cd-1dbe2a32198f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.965287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.977891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd46a8a-6627-4cf1-96a8-9aee33c4900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.978996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd46a8a-6627-4cf1-96a8-9aee33c4900d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.979412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd46a8a-6627-4cf1-96a8-9aee33c4900d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.979814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd46a8a-6627-4cf1-96a8-9aee33c4900d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.996022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd46a8a-6627-4cf1-96a8-9aee33c4900d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.997543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd46a8a-6627-4cf1-96a8-9aee33c4900d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:58.006814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39387914-0183-4a19-9448-3f0da1dd3c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:58.007470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387914-0183-4a19-9448-3f0da1dd3c6a None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.007762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387914-0183-4a19-9448-3f0da1dd3c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.008041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387914-0183-4a19-9448-3f0da1dd3c6a None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.008705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39387914-0183-4a19-9448-3f0da1dd3c6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:58.010141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39387914-0183-4a19-9448-3f0da1dd3c6a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-9dd46a8a-6627-4cf1-96a8-9aee33c4900d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:26:58.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:58.017120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:26:58.017988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:26:58.017988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:58.017988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:58.021255 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 238/469] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:58.022275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd46a8a-6627-4cf1-96a8-9aee33c4900d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:58.125307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd46a8a-6627-4cf1-96a8-9aee33c4900d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:58.158232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 232/470] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:57 2022] POST /identity/v3/users => generated 248 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:26:58.158232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39387914-0183-4a19-9448-3f0da1dd3c6a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:58.188306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d43d6-e0dc-456d-b93f-d3567486859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:58.188599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d43d6-e0dc-456d-b93f-d3567486859c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.188934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d43d6-e0dc-456d-b93f-d3567486859c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.189219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d43d6-e0dc-456d-b93f-d3567486859c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.210835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d43d6-e0dc-456d-b93f-d3567486859c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:58.212347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d43d6-e0dc-456d-b93f-d3567486859c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-688d43d6-e0dc-456d-b93f-d3567486859c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:26:58.242163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:58.243112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:26:58.243960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:26:58.243960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:58.243960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:58.243960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 239/471] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:58.253945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d43d6-e0dc-456d-b93f-d3567486859c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:58.335391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39387914-0183-4a19-9448-3f0da1dd3c6a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:58.346057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:58.375792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a342d4-da62-4ed1-944f-b1125a785561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:58.376414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a342d4-da62-4ed1-944f-b1125a785561 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.376707 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a342d4-da62-4ed1-944f-b1125a785561 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.376978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a342d4-da62-4ed1-944f-b1125a785561 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.377630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a342d4-da62-4ed1-944f-b1125a785561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:58.377944 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a342d4-da62-4ed1-944f-b1125a785561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:58.379458 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a342d4-da62-4ed1-944f-b1125a785561 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:58.389354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:58.395627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 233/472] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:58.397107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3a2c9-f7c6-4923-83ca-c3b3919b7fc2 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.397447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3a2c9-f7c6-4923-83ca-c3b3919b7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.397732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3a2c9-f7c6-4923-83ca-c3b3919b7fc2 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.401657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 234/473] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:58.403773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3a2c9-f7c6-4923-83ca-c3b3919b7fc2 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:58.449875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d43d6-e0dc-456d-b93f-d3567486859c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:58.492936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72659812-19b8-4c88-91f6-9dc13e14ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:58.493523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72659812-19b8-4c88-91f6-9dc13e14ec1b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.493809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72659812-19b8-4c88-91f6-9dc13e14ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.494086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72659812-19b8-4c88-91f6-9dc13e14ec1b None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.494765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72659812-19b8-4c88-91f6-9dc13e14ec1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:58.495199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72659812-19b8-4c88-91f6-9dc13e14ec1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:58.496590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72659812-19b8-4c88-91f6-9dc13e14ec1b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:58.510209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 240/474] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:58.511766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5273-d3c2-4037-8973-75b2abcaeddf None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.512126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5273-d3c2-4037-8973-75b2abcaeddf None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.512471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5273-d3c2-4037-8973-75b2abcaeddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.527618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3a2c9-f7c6-4923-83ca-c3b3919b7fc2 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:58.531784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-055b5273-d3c2-4037-8973-75b2abcaeddf None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:58.533077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-055b5273-d3c2-4037-8973-75b2abcaeddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:58.564984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeba084-ab86-44ef-ae5b-c4f60ccdf276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:58.565946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeba084-ab86-44ef-ae5b-c4f60ccdf276 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.566259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeba084-ab86-44ef-ae5b-c4f60ccdf276 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.566536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeba084-ab86-44ef-ae5b-c4f60ccdf276 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.567384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeba084-ab86-44ef-ae5b-c4f60ccdf276 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:58.568873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeba084-ab86-44ef-ae5b-c4f60ccdf276 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:58.606380 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 241/475] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:58.607298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b5273-d3c2-4037-8973-75b2abcaeddf None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:58.637320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:58.686347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 235/476] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:58 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:58.744884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b5273-d3c2-4037-8973-75b2abcaeddf None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:58.798225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ed2c1-726c-4dfb-aa9b-dbdb5f1b8e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:58.798225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ed2c1-726c-4dfb-aa9b-dbdb5f1b8e41 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.798225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ed2c1-726c-4dfb-aa9b-dbdb5f1b8e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.798225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ed2c1-726c-4dfb-aa9b-dbdb5f1b8e41 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.798687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ed2c1-726c-4dfb-aa9b-dbdb5f1b8e41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:58.798687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ed2c1-726c-4dfb-aa9b-dbdb5f1b8e41 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:58.892061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 242/477] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:58 2022] POST /identity/v3/users => generated 249 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:58.925105 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeba084-ab86-44ef-ae5b-c4f60ccdf276 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:58.997757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:59.054877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeba084-ab86-44ef-ae5b-c4f60ccdf276 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:59.091932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca64bf-864b-4245-91a5-be2fcc30beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:59.092554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca64bf-864b-4245-91a5-be2fcc30beb1 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:59.092838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca64bf-864b-4245-91a5-be2fcc30beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:59.093128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca64bf-864b-4245-91a5-be2fcc30beb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:59.093811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca64bf-864b-4245-91a5-be2fcc30beb1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:59.095231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca64bf-864b-4245-91a5-be2fcc30beb1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:59.142429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.sql.core [None req-1aca64bf-864b-4245-91a5-be2fcc30beb1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 12:26:59.142429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 12:26:59.142429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [parameters: {'id': '47b9a171536f46469d47b316e40534d4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 12:26:59.142429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81822) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-1aca64bf-864b-4245-91a5-be2fcc30beb1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application result.read() Aug 22 12:26:59.170051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return ref.to_dict() Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:26:59.171194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application yield resource Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise self.value Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application session.commit() Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 12:26:59.172172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self.session.flush() Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application compat.raise_( Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 12:26:59.173052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:26:59.174664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application result.read() Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:26:59.175896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [parameters: {'id': '47b9a171536f46469d47b316e40534d4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:59.178040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 12:26:59.180049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:26:59.182253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 236/478] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 22 12:26:58 2022] POST /identity/v3/roles => generated 144 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:59.188600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ed2c1-726c-4dfb-aa9b-dbdb5f1b8e41 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:59.275531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:59.302699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ed2c1-726c-4dfb-aa9b-dbdb5f1b8e41 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:59.340315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbf519-004d-4768-aeb1-dbf80b115f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:59.341318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbf519-004d-4768-aeb1-dbf80b115f98 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:59.341815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbf519-004d-4768-aeb1-dbf80b115f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:59.342318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbf519-004d-4768-aeb1-dbf80b115f98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:59.355782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbf519-004d-4768-aeb1-dbf80b115f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-aadbf519-004d-4768-aeb1-dbf80b115f98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:59.361449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:59.362369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:59.363167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:26:59.365465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 243/479] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:59.371370 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca64bf-864b-4245-91a5-be2fcc30beb1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:59.503373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca64bf-864b-4245-91a5-be2fcc30beb1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:59.522008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:59.551832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1081f-bcff-401b-a247-92ce7fbbbae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:59.551832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1081f-bcff-401b-a247-92ce7fbbbae6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:59.551832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1081f-bcff-401b-a247-92ce7fbbbae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:59.551832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1081f-bcff-401b-a247-92ce7fbbbae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:59.552444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1081f-bcff-401b-a247-92ce7fbbbae6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:59.552716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1081f-bcff-401b-a247-92ce7fbbbae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:59.554115 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1081f-bcff-401b-a247-92ce7fbbbae6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:59.563874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 237/480] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:59.923160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531968b-4d1c-4667-aac3-a4705f2a04fd None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:59.923643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531968b-4d1c-4667-aac3-a4705f2a04fd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:59.923643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531968b-4d1c-4667-aac3-a4705f2a04fd None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:59.925242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 244/481] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:59.931457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b8e71-7a1e-4c3d-a1e3-71dcc4015944 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:59.931875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b8e71-7a1e-4c3d-a1e3-71dcc4015944 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:59.932068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b8e71-7a1e-4c3d-a1e3-71dcc4015944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:59.951463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-390b8e71-7a1e-4c3d-a1e3-71dcc4015944 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:59.952663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-390b8e71-7a1e-4c3d-a1e3-71dcc4015944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:00.030310 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 238/482] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:00.311049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531968b-4d1c-4667-aac3-a4705f2a04fd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:00.430440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531968b-4d1c-4667-aac3-a4705f2a04fd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:00.476941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129f9b9-eb7d-4cc6-a20c-d9bd1f351dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:00.477588 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129f9b9-eb7d-4cc6-a20c-d9bd1f351dca None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.477875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129f9b9-eb7d-4cc6-a20c-d9bd1f351dca None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.478156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129f9b9-eb7d-4cc6-a20c-d9bd1f351dca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.491682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:00.495386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129f9b9-eb7d-4cc6-a20c-d9bd1f351dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6129f9b9-eb7d-4cc6-a20c-d9bd1f351dca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:00.500757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:00.501802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:00.502712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:00.506333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 245/483] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:00.508239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b8e71-7a1e-4c3d-a1e3-71dcc4015944 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:00.558166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1f0a-f076-414a-aaa0-5251253bf709 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.558630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1f0a-f076-414a-aaa0-5251253bf709 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.559004 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1f0a-f076-414a-aaa0-5251253bf709 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.560675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 246/484] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:00.566224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdfbad-8ab2-4432-8168-d4b38cc36716 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.566515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdfbad-8ab2-4432-8168-d4b38cc36716 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.566841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdfbad-8ab2-4432-8168-d4b38cc36716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.586220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-91fdfbad-8ab2-4432-8168-d4b38cc36716 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:00.587475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-91fdfbad-8ab2-4432-8168-d4b38cc36716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:00.669257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b8e71-7a1e-4c3d-a1e3-71dcc4015944 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:00.682952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:00.709580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d420b3-bc52-4f52-9190-a0bcad465b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:00.710653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d420b3-bc52-4f52-9190-a0bcad465b03 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.710942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d420b3-bc52-4f52-9190-a0bcad465b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.711354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d420b3-bc52-4f52-9190-a0bcad465b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.712022 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d420b3-bc52-4f52-9190-a0bcad465b03 None admin] RBAC: Adding query filter params (name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:00.712325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d420b3-bc52-4f52-9190-a0bcad465b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:00.714728 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d420b3-bc52-4f52-9190-a0bcad465b03 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:00.727355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 239/485] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:00.732688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d420b3-bc52-4f52-9190-a0bcad465b03 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:00.733088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 247/486] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:00.851887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d420b3-bc52-4f52-9190-a0bcad465b03 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:00.892758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305c9c5-9e78-445e-ac8a-040c5b23ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:00.893400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305c9c5-9e78-445e-ac8a-040c5b23ce77 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.893683 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305c9c5-9e78-445e-ac8a-040c5b23ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.893958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305c9c5-9e78-445e-ac8a-040c5b23ce77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.905533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305c9c5-9e78-445e-ac8a-040c5b23ce77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:00.907041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305c9c5-9e78-445e-ac8a-040c5b23ce77 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-b305c9c5-9e78-445e-ac8a-040c5b23ce77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:00.922216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:00.923117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:00.923995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:00.923995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:00.923995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:00.923995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 240/487] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:00.929111 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdfbad-8ab2-4432-8168-d4b38cc36716 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.053716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdfbad-8ab2-4432-8168-d4b38cc36716 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.074703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305c9c5-9e78-445e-ac8a-040c5b23ce77 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.083090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.093614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20189488-4063-4f5e-b8af-802bf6bd6eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.093614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20189488-4063-4f5e-b8af-802bf6bd6eea None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.093614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20189488-4063-4f5e-b8af-802bf6bd6eea None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.093614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20189488-4063-4f5e-b8af-802bf6bd6eea None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.094043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20189488-4063-4f5e-b8af-802bf6bd6eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:01.094043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20189488-4063-4f5e-b8af-802bf6bd6eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.094043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20189488-4063-4f5e-b8af-802bf6bd6eea None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.106089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 248/488] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:01.111229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20189488-4063-4f5e-b8af-802bf6bd6eea None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.134298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.237401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305c9c5-9e78-445e-ac8a-040c5b23ce77 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.258484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20189488-4063-4f5e-b8af-802bf6bd6eea None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.286553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc1a99-fe63-4b29-9bcd-0bf34e60d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.287283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc1a99-fe63-4b29-9bcd-0bf34e60d70b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.287793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc1a99-fe63-4b29-9bcd-0bf34e60d70b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.288151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc1a99-fe63-4b29-9bcd-0bf34e60d70b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.299041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd78098-3e13-4604-8f5b-056e1e10388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.299671 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd78098-3e13-4604-8f5b-056e1e10388a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.299956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd78098-3e13-4604-8f5b-056e1e10388a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.300228 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd78098-3e13-4604-8f5b-056e1e10388a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.301764 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc1a99-fe63-4b29-9bcd-0bf34e60d70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-80dc1a99-fe63-4b29-9bcd-0bf34e60d70b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:01.306761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:01.307667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:01.308488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 241/489] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:01.309166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd78098-3e13-4604-8f5b-056e1e10388a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.309730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0771b1-1d30-45a2-84f6-f38d251226e1 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.309730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0771b1-1d30-45a2-84f6-f38d251226e1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.310018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0771b1-1d30-45a2-84f6-f38d251226e1 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.310157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd78098-3e13-4604-8f5b-056e1e10388a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.311287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 242/490] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:01.313433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0771b1-1d30-45a2-84f6-f38d251226e1 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3dd78098-3e13-4604-8f5b-056e1e10388a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:01.327812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:01.329963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 249/491] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea072-f11f-4549-b72e-0b0296d6e827 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.332282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea072-f11f-4549-b72e-0b0296d6e827 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.338502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea072-f11f-4549-b72e-0b0296d6e827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.354756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-19dea072-f11f-4549-b72e-0b0296d6e827 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:01.356139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-19dea072-f11f-4549-b72e-0b0296d6e827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:01.406571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.407069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.425258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0771b1-1d30-45a2-84f6-f38d251226e1 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.432578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 250/492] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:01.433744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dea072-f11f-4549-b72e-0b0296d6e827 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.527499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5915d1-72d6-4085-a439-e7830faf0cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.528182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5915d1-72d6-4085-a439-e7830faf0cfe None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.528411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5915d1-72d6-4085-a439-e7830faf0cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.528693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5915d1-72d6-4085-a439-e7830faf0cfe None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.529362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5915d1-72d6-4085-a439-e7830faf0cfe None admin] RBAC: Adding query filter params (name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:01.529668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5915d1-72d6-4085-a439-e7830faf0cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.531091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5915d1-72d6-4085-a439-e7830faf0cfe None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.548755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dea072-f11f-4549-b72e-0b0296d6e827 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.552827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 243/493] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:01.557924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5915d1-72d6-4085-a439-e7830faf0cfe None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.592458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205a12a-342b-473a-9b6e-de3231efed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.593309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a12a-342b-473a-9b6e-de3231efed04 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.594156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a12a-342b-473a-9b6e-de3231efed04 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.594630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a12a-342b-473a-9b6e-de3231efed04 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.595777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205a12a-342b-473a-9b6e-de3231efed04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:01.596226 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205a12a-342b-473a-9b6e-de3231efed04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.599382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205a12a-342b-473a-9b6e-de3231efed04 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.644955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 251/494] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:01.646780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e862b-9a15-4140-8c02-707882417453 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.647075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e862b-9a15-4140-8c02-707882417453 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.647452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e862b-9a15-4140-8c02-707882417453 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.652951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 252/495] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:01.653746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e862b-9a15-4140-8c02-707882417453 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.680175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5915d1-72d6-4085-a439-e7830faf0cfe None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.693674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.717415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebbbdb-9fcb-4572-af20-46ef1314f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.718377 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebbbdb-9fcb-4572-af20-46ef1314f666 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.718812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebbbdb-9fcb-4572-af20-46ef1314f666 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.719235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebbbdb-9fcb-4572-af20-46ef1314f666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.731828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebbbdb-9fcb-4572-af20-46ef1314f666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.733448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebbbdb-9fcb-4572-af20-46ef1314f666 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.741263 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-2eebbbdb-9fcb-4572-af20-46ef1314f666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:01.750000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:01.752226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:01.753317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:01.753317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:01.753317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:01.753317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 244/496] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:01.753317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9bc98-baf5-469b-a49b-425ad88d01b3 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.753317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9bc98-baf5-469b-a49b-425ad88d01b3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.753749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9bc98-baf5-469b-a49b-425ad88d01b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.767922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e862b-9a15-4140-8c02-707882417453 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.773112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-95d9bc98-baf5-469b-a49b-425ad88d01b3 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:01.774410 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-95d9bc98-baf5-469b-a49b-425ad88d01b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:01.807654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65e67-dfa0-4f00-b64b-2cb68196a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.808315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65e67-dfa0-4f00-b64b-2cb68196a4db None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.808550 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65e67-dfa0-4f00-b64b-2cb68196a4db None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.808811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65e67-dfa0-4f00-b64b-2cb68196a4db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.847469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 245/497] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:01.848573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9bc98-baf5-469b-a49b-425ad88d01b3 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.902473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe65e67-dfa0-4f00-b64b-2cb68196a4db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.904331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe65e67-dfa0-4f00-b64b-2cb68196a4db None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.954368 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.955338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9bc98-baf5-469b-a49b-425ad88d01b3 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.986288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.996208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f24a4-a1cd-4315-94dc-53645d8ce15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.996825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f24a4-a1cd-4315-94dc-53645d8ce15a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.997110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f24a4-a1cd-4315-94dc-53645d8ce15a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.997452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f24a4-a1cd-4315-94dc-53645d8ce15a None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.998102 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f24a4-a1cd-4315-94dc-53645d8ce15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:01.998521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f24a4-a1cd-4315-94dc-53645d8ce15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.000001 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f24a4-a1cd-4315-94dc-53645d8ce15a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.012382 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 246/498] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:02.013159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f24a4-a1cd-4315-94dc-53645d8ce15a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.045707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 253/499] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:02.046601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65e67-dfa0-4f00-b64b-2cb68196a4db None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.148659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f24a4-a1cd-4315-94dc-53645d8ce15a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.153693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65e67-dfa0-4f00-b64b-2cb68196a4db None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.190236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6c6f7-e9e8-4b16-89f8-ea7424390739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.191024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118692-3c44-414f-9317-2a08f54b1481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.191157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c6f7-e9e8-4b16-89f8-ea7424390739 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.191403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c6f7-e9e8-4b16-89f8-ea7424390739 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.192205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c6f7-e9e8-4b16-89f8-ea7424390739 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.192329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118692-3c44-414f-9317-2a08f54b1481 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.192653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118692-3c44-414f-9317-2a08f54b1481 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.192991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118692-3c44-414f-9317-2a08f54b1481 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.196018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.200980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6c6f7-e9e8-4b16-89f8-ea7424390739 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.202544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6c6f7-e9e8-4b16-89f8-ea7424390739 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.203501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4118692-3c44-414f-9317-2a08f54b1481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-e4118692-3c44-414f-9317-2a08f54b1481 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:02.214875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:02.216004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 247/500] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:02.217027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118692-3c44-414f-9317-2a08f54b1481 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c7d6c6f7-e9e8-4b16-89f8-ea7424390739 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:02.222578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:02.223733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:02.224957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:02.224957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:02.224957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:02.224957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:02.224957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:02.224957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:02.224957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:02.224957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:02.224957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:02.224957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:02.226451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 254/501] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:02.226451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6c6f7-e9e8-4b16-89f8-ea7424390739 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.270330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.324437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118692-3c44-414f-9317-2a08f54b1481 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.336547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6c6f7-e9e8-4b16-89f8-ea7424390739 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.361200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddc0ee-169f-4e87-9f0f-4b4580aacaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.361832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddc0ee-169f-4e87-9f0f-4b4580aacaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.362109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddc0ee-169f-4e87-9f0f-4b4580aacaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.362407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddc0ee-169f-4e87-9f0f-4b4580aacaa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.373411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddc0ee-169f-4e87-9f0f-4b4580aacaa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.374898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddc0ee-169f-4e87-9f0f-4b4580aacaa7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.376958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39286cdf-7010-4a32-b2c2-b744e0d3de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.377855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39286cdf-7010-4a32-b2c2-b744e0d3de12 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.378336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39286cdf-7010-4a32-b2c2-b744e0d3de12 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.378777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39286cdf-7010-4a32-b2c2-b744e0d3de12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.389453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39286cdf-7010-4a32-b2c2-b744e0d3de12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-efddc0ee-169f-4e87-9f0f-4b4580aacaa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:02.389813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:02.390925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:02.391913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:02.391913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:02.391913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:02.391913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 248/502] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:02.392151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddc0ee-169f-4e87-9f0f-4b4580aacaa7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-39286cdf-7010-4a32-b2c2-b744e0d3de12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:02.394623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:02.396577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 255/503] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:02.397527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39286cdf-7010-4a32-b2c2-b744e0d3de12 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.452672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.497302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.497853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39286cdf-7010-4a32-b2c2-b744e0d3de12 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.499994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddc0ee-169f-4e87-9f0f-4b4580aacaa7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.532469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401d4a8-1873-4929-b298-12102a71f328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.533049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db11c-7609-4202-8076-9f8e41daeba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.533192 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401d4a8-1873-4929-b298-12102a71f328 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.533347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401d4a8-1873-4929-b298-12102a71f328 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.533622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401d4a8-1873-4929-b298-12102a71f328 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.533715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db11c-7609-4202-8076-9f8e41daeba2 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.533922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db11c-7609-4202-8076-9f8e41daeba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.534211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db11c-7609-4202-8076-9f8e41daeba2 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.534382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401d4a8-1873-4929-b298-12102a71f328 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:02.534692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401d4a8-1873-4929-b298-12102a71f328 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.534886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db11c-7609-4202-8076-9f8e41daeba2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:02.535259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db11c-7609-4202-8076-9f8e41daeba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.536924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401d4a8-1873-4929-b298-12102a71f328 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.537463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db11c-7609-4202-8076-9f8e41daeba2 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.545837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 249/504] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:02.547070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3879-b870-4ef9-b59e-12f23270898b None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.547356 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3879-b870-4ef9-b59e-12f23270898b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.552655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3879-b870-4ef9-b59e-12f23270898b None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.552655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 250/505] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:02.552655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe3879-b870-4ef9-b59e-12f23270898b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.560789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 256/506] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:02.560789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401d4a8-1873-4929-b298-12102a71f328 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.652930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe3879-b870-4ef9-b59e-12f23270898b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.659074 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401d4a8-1873-4929-b298-12102a71f328 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.673996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.686095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3253e9b-190a-464b-8786-bdb874e4fbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.686735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253e9b-190a-464b-8786-bdb874e4fbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.687013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253e9b-190a-464b-8786-bdb874e4fbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.687282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253e9b-190a-464b-8786-bdb874e4fbe7 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.687909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3253e9b-190a-464b-8786-bdb874e4fbe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:02.688211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3253e9b-190a-464b-8786-bdb874e4fbe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.689580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3253e9b-190a-464b-8786-bdb874e4fbe7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.693931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661eb37-a972-471e-8199-461348f5fbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.694572 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661eb37-a972-471e-8199-461348f5fbad None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.694864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661eb37-a972-471e-8199-461348f5fbad None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.695143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661eb37-a972-471e-8199-461348f5fbad None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.695810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661eb37-a972-471e-8199-461348f5fbad None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:02.696119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661eb37-a972-471e-8199-461348f5fbad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.697517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661eb37-a972-471e-8199-461348f5fbad None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.702586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 251/507] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:02.703462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3253e9b-190a-464b-8786-bdb874e4fbe7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.712851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 257/508] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:02.713959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc00813-7086-49e9-9bec-7e0d9f9e86c6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.714282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc00813-7086-49e9-9bec-7e0d9f9e86c6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.714558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc00813-7086-49e9-9bec-7e0d9f9e86c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.731559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.733106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4cc00813-7086-49e9-9bec-7e0d9f9e86c6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:02.734342 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4cc00813-7086-49e9-9bec-7e0d9f9e86c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:02.799564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 258/509] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:02.800404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc00813-7086-49e9-9bec-7e0d9f9e86c6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.805961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3253e9b-190a-464b-8786-bdb874e4fbe7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.841704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb1448-bc89-43fe-9178-359b38721991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.842738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb1448-bc89-43fe-9178-359b38721991 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.843018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb1448-bc89-43fe-9178-359b38721991 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.843622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb1448-bc89-43fe-9178-359b38721991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.856462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb1448-bc89-43fe-9178-359b38721991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.858486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb1448-bc89-43fe-9178-359b38721991 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-2afb1448-bc89-43fe-9178-359b38721991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:02.874615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:02.875558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:02.876422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:02.876422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:02.876422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:02.876422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 252/510] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:02.876638 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb1448-bc89-43fe-9178-359b38721991 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.904652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc00813-7086-49e9-9bec-7e0d9f9e86c6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.912620 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.939397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0ac80-9bf5-41e2-ba42-854101314511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.940219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ac80-9bf5-41e2-ba42-854101314511 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.942883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ac80-9bf5-41e2-ba42-854101314511 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.942883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ac80-9bf5-41e2-ba42-854101314511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.960104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.985091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb1448-bc89-43fe-9178-359b38721991 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.019492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0ac80-9bf5-41e2-ba42-854101314511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.021940 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1834b-5007-44d2-9d56-0a11b836a426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.022603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1834b-5007-44d2-9d56-0a11b836a426 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.022887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1834b-5007-44d2-9d56-0a11b836a426 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.023165 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1834b-5007-44d2-9d56-0a11b836a426 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.023331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0ac80-9bf5-41e2-ba42-854101314511 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.030071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1834b-5007-44d2-9d56-0a11b836a426 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.031573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1834b-5007-44d2-9d56-0a11b836a426 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-ccf1834b-5007-44d2-9d56-0a11b836a426 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:03.043894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:03.044967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:03.046032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:03.046032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:03.046032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:03.046032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:03.046032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:03.046032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:03.046032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:03.046032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:03.049753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 253/511] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:03.050668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1834b-5007-44d2-9d56-0a11b836a426 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.130051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 259/512] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:03.131282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0ac80-9bf5-41e2-ba42-854101314511 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.140651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.152887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1834b-5007-44d2-9d56-0a11b836a426 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.187976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b508ac6-ab6b-4c70-8353-76125325e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.188608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b508ac6-ab6b-4c70-8353-76125325e943 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.188888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b508ac6-ab6b-4c70-8353-76125325e943 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.189159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b508ac6-ab6b-4c70-8353-76125325e943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.191322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.201578 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b508ac6-ab6b-4c70-8353-76125325e943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.203080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b508ac6-ab6b-4c70-8353-76125325e943 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-0b508ac6-ab6b-4c70-8353-76125325e943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:03.217601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:03.218632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:03.219486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:03.219486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:03.219486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:03.219486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 254/513] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:03.219486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b508ac6-ab6b-4c70-8353-76125325e943 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.238100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0ac80-9bf5-41e2-ba42-854101314511 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.273388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e292c4-3137-4cc5-b400-b67d8af6bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.273994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e292c4-3137-4cc5-b400-b67d8af6bf78 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.274315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e292c4-3137-4cc5-b400-b67d8af6bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.274590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e292c4-3137-4cc5-b400-b67d8af6bf78 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.275268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e292c4-3137-4cc5-b400-b67d8af6bf78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.275575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e292c4-3137-4cc5-b400-b67d8af6bf78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.276976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e292c4-3137-4cc5-b400-b67d8af6bf78 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.288590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 260/514] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:03.289254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e292c4-3137-4cc5-b400-b67d8af6bf78 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.320387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b508ac6-ab6b-4c70-8353-76125325e943 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.352742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.353720 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375c556-0358-4f62-b960-a472b60a0c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.354361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375c556-0358-4f62-b960-a472b60a0c18 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.354644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375c556-0358-4f62-b960-a472b60a0c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.354914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375c556-0358-4f62-b960-a472b60a0c18 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.355592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375c556-0358-4f62-b960-a472b60a0c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.355894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375c556-0358-4f62-b960-a472b60a0c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.357333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375c556-0358-4f62-b960-a472b60a0c18 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.375410 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 255/515] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:03.376042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375c556-0358-4f62-b960-a472b60a0c18 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.390063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e292c4-3137-4cc5-b400-b67d8af6bf78 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.421659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.422996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc098858-0ea6-443a-b916-b4872ee8883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.423627 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc098858-0ea6-443a-b916-b4872ee8883a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.423907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc098858-0ea6-443a-b916-b4872ee8883a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.424181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc098858-0ea6-443a-b916-b4872ee8883a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.435144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc098858-0ea6-443a-b916-b4872ee8883a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.436596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc098858-0ea6-443a-b916-b4872ee8883a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-cc098858-0ea6-443a-b916-b4872ee8883a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:03.451374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:03.452307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:03.453613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:03.453613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:03.453613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:03.453613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 261/516] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:03.453613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc098858-0ea6-443a-b916-b4872ee8883a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.478621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375c556-0358-4f62-b960-a472b60a0c18 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.512327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977669f-5c4b-4288-a882-aeb50d706c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.512954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977669f-5c4b-4288-a882-aeb50d706c10 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.513229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977669f-5c4b-4288-a882-aeb50d706c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.513504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977669f-5c4b-4288-a882-aeb50d706c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.524087 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977669f-5c4b-4288-a882-aeb50d706c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.525520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977669f-5c4b-4288-a882-aeb50d706c10 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-4977669f-5c4b-4288-a882-aeb50d706c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:03.539554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:03.540622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:03.541851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:03.541851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:03.541851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:03.541851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 256/517] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:03.541851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977669f-5c4b-4288-a882-aeb50d706c10 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.631739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc098858-0ea6-443a-b916-b4872ee8883a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.648644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.660042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.664593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977669f-5c4b-4288-a882-aeb50d706c10 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.665675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7da28-2c04-4333-8b1a-10c194d2b761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.666318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7da28-2c04-4333-8b1a-10c194d2b761 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.666601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7da28-2c04-4333-8b1a-10c194d2b761 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.666876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7da28-2c04-4333-8b1a-10c194d2b761 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.667509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7da28-2c04-4333-8b1a-10c194d2b761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.667813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7da28-2c04-4333-8b1a-10c194d2b761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.669184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7da28-2c04-4333-8b1a-10c194d2b761 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.681499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 262/518] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:03.682714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7da28-2c04-4333-8b1a-10c194d2b761 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.700272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366aa76-e1d0-42c2-bef6-e6852ec8c5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.701047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366aa76-e1d0-42c2-bef6-e6852ec8c5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.701329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366aa76-e1d0-42c2-bef6-e6852ec8c5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.701603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366aa76-e1d0-42c2-bef6-e6852ec8c5d1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.709677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366aa76-e1d0-42c2-bef6-e6852ec8c5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.711505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366aa76-e1d0-42c2-bef6-e6852ec8c5d1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-e366aa76-e1d0-42c2-bef6-e6852ec8c5d1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:03.724217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:03.725122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 257/519] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:03.726024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366aa76-e1d0-42c2-bef6-e6852ec8c5d1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.787428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7da28-2c04-4333-8b1a-10c194d2b761 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.820966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d071de8-280a-4a98-bde5-24ecd07eed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.821563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d071de8-280a-4a98-bde5-24ecd07eed9a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.821841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d071de8-280a-4a98-bde5-24ecd07eed9a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.822110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d071de8-280a-4a98-bde5-24ecd07eed9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.822856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d071de8-280a-4a98-bde5-24ecd07eed9a None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=9e2f71ebeca2441791a0241de737cad0) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.823164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d071de8-280a-4a98-bde5-24ecd07eed9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.824608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d071de8-280a-4a98-bde5-24ecd07eed9a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.829424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366aa76-e1d0-42c2-bef6-e6852ec8c5d1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.829772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 263/520] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/role_assignments?user.id=9e2f71ebeca2441791a0241de737cad0&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:03.830560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d071de8-280a-4a98-bde5-24ecd07eed9a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.867473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3458a-c5c9-4f24-a464-6386635ebeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.868091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3458a-c5c9-4f24-a464-6386635ebeab None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.868370 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3458a-c5c9-4f24-a464-6386635ebeab None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.868647 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3458a-c5c9-4f24-a464-6386635ebeab None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.869294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3458a-c5c9-4f24-a464-6386635ebeab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.869594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3458a-c5c9-4f24-a464-6386635ebeab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.871028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3458a-c5c9-4f24-a464-6386635ebeab None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.878782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.885959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 258/521] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:03.885959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3458a-c5c9-4f24-a464-6386635ebeab None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.911419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.952111 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d071de8-280a-4a98-bde5-24ecd07eed9a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.989730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aace5c4-dfef-4a73-8875-cd2fa3aac461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.990436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aace5c4-dfef-4a73-8875-cd2fa3aac461 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.990722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aace5c4-dfef-4a73-8875-cd2fa3aac461 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.991001 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aace5c4-dfef-4a73-8875-cd2fa3aac461 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.991682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aace5c4-dfef-4a73-8875-cd2fa3aac461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.991991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aace5c4-dfef-4a73-8875-cd2fa3aac461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.993392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aace5c4-dfef-4a73-8875-cd2fa3aac461 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.001694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3458a-c5c9-4f24-a464-6386635ebeab None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.007386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 264/522] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.008046 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aace5c4-dfef-4a73-8875-cd2fa3aac461 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.043200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191b21c-f87b-4398-b561-192b80b34815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.043734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b21c-f87b-4398-b561-192b80b34815 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.044010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b21c-f87b-4398-b561-192b80b34815 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.044279 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b21c-f87b-4398-b561-192b80b34815 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.052456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191b21c-f87b-4398-b561-192b80b34815 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.053915 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191b21c-f87b-4398-b561-192b80b34815 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-9191b21c-f87b-4398-b561-192b80b34815 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:04.065783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:04.067364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 259/523] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:04.068280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191b21c-f87b-4398-b561-192b80b34815 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.119906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aace5c4-dfef-4a73-8875-cd2fa3aac461 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.121592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.155994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57161-050e-4a0a-966b-031e7f72d953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.156702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57161-050e-4a0a-966b-031e7f72d953 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.156981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57161-050e-4a0a-966b-031e7f72d953 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.157253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57161-050e-4a0a-966b-031e7f72d953 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.157982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d57161-050e-4a0a-966b-031e7f72d953 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:04.158316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d57161-050e-4a0a-966b-031e7f72d953 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.158687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.159770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d57161-050e-4a0a-966b-031e7f72d953 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.185996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 265/524] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.186843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191b21c-f87b-4398-b561-192b80b34815 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.187385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57161-050e-4a0a-966b-031e7f72d953 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.222276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d11de-bccb-4228-b44b-77a2b7326eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.222920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d11de-bccb-4228-b44b-77a2b7326eac None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.223895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d11de-bccb-4228-b44b-77a2b7326eac None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.224173 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d11de-bccb-4228-b44b-77a2b7326eac None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.224911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d11de-bccb-4228-b44b-77a2b7326eac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.226285 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d11de-bccb-4228-b44b-77a2b7326eac None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.297607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57161-050e-4a0a-966b-031e7f72d953 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.331499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18a66a-4377-4174-b6ec-1b4c6a4efb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.332132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18a66a-4377-4174-b6ec-1b4c6a4efb95 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.333053 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18a66a-4377-4174-b6ec-1b4c6a4efb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.333338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18a66a-4377-4174-b6ec-1b4c6a4efb95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.340201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18a66a-4377-4174-b6ec-1b4c6a4efb95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.341659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18a66a-4377-4174-b6ec-1b4c6a4efb95 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.350558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 260/525] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:27:04 2022] POST /identity/v3/users => generated 247 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:04.350558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d11de-bccb-4228-b44b-77a2b7326eac None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3b18a66a-4377-4174-b6ec-1b4c6a4efb95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:04.362904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:04.370646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:04.371642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:04.371642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:04.371642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:04.371642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:04.371642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:04.371642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:04.371642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:04.371642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:04.371642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 266/526] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:04.371642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18a66a-4377-4174-b6ec-1b4c6a4efb95 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.401338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.481357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d11de-bccb-4228-b44b-77a2b7326eac None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.502494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18a66a-4377-4174-b6ec-1b4c6a4efb95 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.521164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed13bfe-3966-461b-8288-953bac1b73c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.521943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed13bfe-3966-461b-8288-953bac1b73c7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.522365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed13bfe-3966-461b-8288-953bac1b73c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.522741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed13bfe-3966-461b-8288-953bac1b73c7 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.523634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed13bfe-3966-461b-8288-953bac1b73c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:04.523990 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed13bfe-3966-461b-8288-953bac1b73c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.525639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed13bfe-3966-461b-8288-953bac1b73c7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.532611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.541078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d6d2b-0eff-4ac5-9b7e-32996104f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.541779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6d2b-0eff-4ac5-9b7e-32996104f3ae None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.542142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6d2b-0eff-4ac5-9b7e-32996104f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.542545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6d2b-0eff-4ac5-9b7e-32996104f3ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.570019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 261/527] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.570877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed13bfe-3966-461b-8288-953bac1b73c7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.643801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d6d2b-0eff-4ac5-9b7e-32996104f3ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.646057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d6d2b-0eff-4ac5-9b7e-32996104f3ae None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.673230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.693187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed13bfe-3966-461b-8288-953bac1b73c7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.739989 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82b1e4-f273-4e47-9bb7-98e4fb4f6dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.740760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82b1e4-f273-4e47-9bb7-98e4fb4f6dee None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.741143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82b1e4-f273-4e47-9bb7-98e4fb4f6dee None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.741423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82b1e4-f273-4e47-9bb7-98e4fb4f6dee None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.742121 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82b1e4-f273-4e47-9bb7-98e4fb4f6dee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:04.742470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82b1e4-f273-4e47-9bb7-98e4fb4f6dee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.744649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82b1e4-f273-4e47-9bb7-98e4fb4f6dee None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.760624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 262/528] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.761866 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82b1e4-f273-4e47-9bb7-98e4fb4f6dee None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.770298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 267/529] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:04.771521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d6d2b-0eff-4ac5-9b7e-32996104f3ae None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.834663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.888053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82b1e4-f273-4e47-9bb7-98e4fb4f6dee None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.899579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d6d2b-0eff-4ac5-9b7e-32996104f3ae None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.930106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.931011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43481bd6-87af-4947-98f8-245b65b1e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.931522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43481bd6-87af-4947-98f8-245b65b1e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.931806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43481bd6-87af-4947-98f8-245b65b1e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.932079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43481bd6-87af-4947-98f8-245b65b1e5e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.950233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858044b-2de0-4210-9f58-8f16ad118626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.951060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858044b-2de0-4210-9f58-8f16ad118626 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.951350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858044b-2de0-4210-9f58-8f16ad118626 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.951695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858044b-2de0-4210-9f58-8f16ad118626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.952473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858044b-2de0-4210-9f58-8f16ad118626 None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=a3e56c9d900f4e4e91ea944d4cb0a40a) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:04.952826 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858044b-2de0-4210-9f58-8f16ad118626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.954936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858044b-2de0-4210-9f58-8f16ad118626 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.962932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 268/530] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/role_assignments?user.id=a3e56c9d900f4e4e91ea944d4cb0a40a&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.964194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858044b-2de0-4210-9f58-8f16ad118626 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.045150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43481bd6-87af-4947-98f8-245b65b1e5e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.046701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43481bd6-87af-4947-98f8-245b65b1e5e6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.150606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:05.152392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858044b-2de0-4210-9f58-8f16ad118626 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.193273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21017ab-1ebc-4fb8-878c-1e26d5edf3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.194337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21017ab-1ebc-4fb8-878c-1e26d5edf3ec None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.194951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21017ab-1ebc-4fb8-878c-1e26d5edf3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.195431 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21017ab-1ebc-4fb8-878c-1e26d5edf3ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.207467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21017ab-1ebc-4fb8-878c-1e26d5edf3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.209316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21017ab-1ebc-4fb8-878c-1e26d5edf3ec None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.215041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 263/531] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:05.221283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43481bd6-87af-4947-98f8-245b65b1e5e6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b21017ab-1ebc-4fb8-878c-1e26d5edf3ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:05.226728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:05.227674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:05.228545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:05.228545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:05.228545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:05.230644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 269/532] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:05.243432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21017ab-1ebc-4fb8-878c-1e26d5edf3ec None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.306619 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:05.383460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43481bd6-87af-4947-98f8-245b65b1e5e6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.431960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21017ab-1ebc-4fb8-878c-1e26d5edf3ec None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.445188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5739cc-3bb9-47cd-b7ba-65ba376963a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.445832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5739cc-3bb9-47cd-b7ba-65ba376963a0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.446109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5739cc-3bb9-47cd-b7ba-65ba376963a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.446410 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5739cc-3bb9-47cd-b7ba-65ba376963a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.465937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5739cc-3bb9-47cd-b7ba-65ba376963a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.467424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5739cc-3bb9-47cd-b7ba-65ba376963a0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-bf5739cc-3bb9-47cd-b7ba-65ba376963a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:05.496815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:05.497787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:05.499274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:05.499274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:05.499274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:05.499274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 264/533] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:05.503713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5739cc-3bb9-47cd-b7ba-65ba376963a0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.512180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccea6d-43cf-44e2-abe0-1c28f21fbf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.512800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccea6d-43cf-44e2-abe0-1c28f21fbf37 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.519586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccea6d-43cf-44e2-abe0-1c28f21fbf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.519586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccea6d-43cf-44e2-abe0-1c28f21fbf37 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.519586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccea6d-43cf-44e2-abe0-1c28f21fbf37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:05.519586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccea6d-43cf-44e2-abe0-1c28f21fbf37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.519586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccea6d-43cf-44e2-abe0-1c28f21fbf37 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.534573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:05.546644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 270/534] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:05.555632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccea6d-43cf-44e2-abe0-1c28f21fbf37 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.621439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5739cc-3bb9-47cd-b7ba-65ba376963a0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.660720 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dff74-08cb-4f35-acd1-8f5e7dca1688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.661394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dff74-08cb-4f35-acd1-8f5e7dca1688 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.661682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dff74-08cb-4f35-acd1-8f5e7dca1688 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.661963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dff74-08cb-4f35-acd1-8f5e7dca1688 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.662716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dff74-08cb-4f35-acd1-8f5e7dca1688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:05.663008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dff74-08cb-4f35-acd1-8f5e7dca1688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.665606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dff74-08cb-4f35-acd1-8f5e7dca1688 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.677994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 265/535] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:05.683484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dff74-08cb-4f35-acd1-8f5e7dca1688 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.739692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:05.750160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccea6d-43cf-44e2-abe0-1c28f21fbf37 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.756531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:05.793198 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dff74-08cb-4f35-acd1-8f5e7dca1688 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.830485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416ffd1-8675-498d-90fd-98568f4e90eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.831125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ffd1-8675-498d-90fd-98568f4e90eb None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.831464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ffd1-8675-498d-90fd-98568f4e90eb None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.831743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ffd1-8675-498d-90fd-98568f4e90eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.838880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98167ffc-7606-4a60-9635-275eedbfbea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.839292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416ffd1-8675-498d-90fd-98568f4e90eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.839531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98167ffc-7606-4a60-9635-275eedbfbea9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.839822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98167ffc-7606-4a60-9635-275eedbfbea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.840105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98167ffc-7606-4a60-9635-275eedbfbea9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.840848 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416ffd1-8675-498d-90fd-98568f4e90eb None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-b416ffd1-8675-498d-90fd-98568f4e90eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:05.852597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:05.853567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:05.854854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:05.854854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:05.854854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:05.854854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:05.854854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:05.854854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:05.854854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:05.854854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:05.854854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 266/536] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:05.855550 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98167ffc-7606-4a60-9635-275eedbfbea9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.856739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98167ffc-7606-4a60-9635-275eedbfbea9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.859576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416ffd1-8675-498d-90fd-98568f4e90eb None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-98167ffc-7606-4a60-9635-275eedbfbea9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:05.888542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:05.889473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:05.891491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:05.891491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:05.891491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:05.891491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:05.891491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:05.891491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:05.891491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:05.891491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:05.891491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 271/537] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:05.899175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98167ffc-7606-4a60-9635-275eedbfbea9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.983953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416ffd1-8675-498d-90fd-98568f4e90eb None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.012882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:06.025063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433fa3a-5391-4cff-b1cd-e6a4528e4e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.025769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433fa3a-5391-4cff-b1cd-e6a4528e4e97 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.025937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98167ffc-7606-4a60-9635-275eedbfbea9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.026213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433fa3a-5391-4cff-b1cd-e6a4528e4e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.026565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433fa3a-5391-4cff-b1cd-e6a4528e4e97 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.027501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433fa3a-5391-4cff-b1cd-e6a4528e4e97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:06.027888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433fa3a-5391-4cff-b1cd-e6a4528e4e97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.030265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433fa3a-5391-4cff-b1cd-e6a4528e4e97 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.050384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 267/538] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:06.052550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e1b9-ad79-490a-943f-df66fde4cf32 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.052923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e1b9-ad79-490a-943f-df66fde4cf32 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.053471 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e1b9-ad79-490a-943f-df66fde4cf32 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.055137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 268/539] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:06.055918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e1b9-ad79-490a-943f-df66fde4cf32 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:06.069135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf2864-f697-4404-a578-9f96d1b5ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.069756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2864-f697-4404-a578-9f96d1b5ce2e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.070467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2864-f697-4404-a578-9f96d1b5ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.070761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2864-f697-4404-a578-9f96d1b5ce2e None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.071866 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf2864-f697-4404-a578-9f96d1b5ce2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:06.072183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf2864-f697-4404-a578-9f96d1b5ce2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.073929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf2864-f697-4404-a578-9f96d1b5ce2e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.093799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 272/540] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:06.095287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770e7d-73b2-4bcb-b4f6-452fad093427 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.095762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770e7d-73b2-4bcb-b4f6-452fad093427 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.096122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770e7d-73b2-4bcb-b4f6-452fad093427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.116290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-09770e7d-73b2-4bcb-b4f6-452fad093427 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:06.117589 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-09770e7d-73b2-4bcb-b4f6-452fad093427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:06.130571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:06.203816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 273/541] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:06.205248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09770e7d-73b2-4bcb-b4f6-452fad093427 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:06.209876 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e1b9-ad79-490a-943f-df66fde4cf32 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.253746 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd514e-7154-4885-99e3-4d68595cbdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.256229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd514e-7154-4885-99e3-4d68595cbdb0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.256771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd514e-7154-4885-99e3-4d68595cbdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.257286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd514e-7154-4885-99e3-4d68595cbdb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.258882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd514e-7154-4885-99e3-4d68595cbdb0 None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=948a5df1d4244c839a7faeb54f93dfbb) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:06.259881 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd514e-7154-4885-99e3-4d68595cbdb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.261936 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd514e-7154-4885-99e3-4d68595cbdb0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.272811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 269/542] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/role_assignments?user.id=948a5df1d4244c839a7faeb54f93dfbb&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:06.363004 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09770e7d-73b2-4bcb-b4f6-452fad093427 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.407275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444241d-457f-4a2e-ab4d-cec3867680df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.407889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444241d-457f-4a2e-ab4d-cec3867680df None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.408171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444241d-457f-4a2e-ab4d-cec3867680df None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.408446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444241d-457f-4a2e-ab4d-cec3867680df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.409239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444241d-457f-4a2e-ab4d-cec3867680df None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=80696f8fcd8e4d01b303bdfd81a6dc9f) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:06.409558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444241d-457f-4a2e-ab4d-cec3867680df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.411098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444241d-457f-4a2e-ab4d-cec3867680df None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.421453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 274/543] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/role_assignments?user.id=80696f8fcd8e4d01b303bdfd81a6dc9f&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:06.519027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd514e-7154-4885-99e3-4d68595cbdb0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:06.579725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:06.641061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd514e-7154-4885-99e3-4d68595cbdb0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.678620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344d2c0-0c63-4ddc-bd5b-244ab03afccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.679258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344d2c0-0c63-4ddc-bd5b-244ab03afccb None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.679537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344d2c0-0c63-4ddc-bd5b-244ab03afccb None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.679806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344d2c0-0c63-4ddc-bd5b-244ab03afccb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.690902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344d2c0-0c63-4ddc-bd5b-244ab03afccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-1344d2c0-0c63-4ddc-bd5b-244ab03afccb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:06.696977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:06.697885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:06.698729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 270/544] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:06.704244 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444241d-457f-4a2e-ab4d-cec3867680df None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:06.719971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:06.728663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7337ad-b07d-4a12-aac7-a52abbfe2466 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.728950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7337ad-b07d-4a12-aac7-a52abbfe2466 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.729227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7337ad-b07d-4a12-aac7-a52abbfe2466 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.730793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 271/545] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:06.736438 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793d1b-de94-4769-8776-e50de2221185 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.736727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793d1b-de94-4769-8776-e50de2221185 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.737011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793d1b-de94-4769-8776-e50de2221185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.765595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-74793d1b-de94-4769-8776-e50de2221185 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:06.769507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-74793d1b-de94-4769-8776-e50de2221185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:06.875562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444241d-457f-4a2e-ab4d-cec3867680df None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.915867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 272/546] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:06.917566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1b10e-40df-4767-80c9-eeb7b0663778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.918435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b10e-40df-4767-80c9-eeb7b0663778 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.918934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b10e-40df-4767-80c9-eeb7b0663778 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.919399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b10e-40df-4767-80c9-eeb7b0663778 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.920252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1b10e-40df-4767-80c9-eeb7b0663778 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:06.920770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1b10e-40df-4767-80c9-eeb7b0663778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.922479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1b10e-40df-4767-80c9-eeb7b0663778 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.931896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 275/547] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:06.937571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793d1b-de94-4769-8776-e50de2221185 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.000426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.073817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793d1b-de94-4769-8776-e50de2221185 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.119211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bfb89-7e7a-43cd-aa20-cbf56a14b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.120213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bfb89-7e7a-43cd-aa20-cbf56a14b157 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.120687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bfb89-7e7a-43cd-aa20-cbf56a14b157 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.121169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bfb89-7e7a-43cd-aa20-cbf56a14b157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.137762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bfb89-7e7a-43cd-aa20-cbf56a14b157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:07.139527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bfb89-7e7a-43cd-aa20-cbf56a14b157 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:07.144525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4379b-5ea3-4783-93ca-429616701ed5 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.145689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4379b-5ea3-4783-93ca-429616701ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.146342 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4379b-5ea3-4783-93ca-429616701ed5 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.147868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 276/548] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:07.157160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cbfc6-5c63-4f3f-af68-13bd2df56706 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.157452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cbfc6-5c63-4f3f-af68-13bd2df56706 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.157735 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cbfc6-5c63-4f3f-af68-13bd2df56706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-164bfb89-7e7a-43cd-aa20-cbf56a14b157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:07.163120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:07.163991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:07.165350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:07.165350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:07.165350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:07.167589 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 273/549] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:07.176593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bfb89-7e7a-43cd-aa20-cbf56a14b157 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.199203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fa7cbfc6-5c63-4f3f-af68-13bd2df56706 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:07.200424 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fa7cbfc6-5c63-4f3f-af68-13bd2df56706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:07.287500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.297958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bfb89-7e7a-43cd-aa20-cbf56a14b157 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.313375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 277/550] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:07.322718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cbfc6-5c63-4f3f-af68-13bd2df56706 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.326381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.336858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142977b8-2531-4b70-a0fd-87e9e5ed625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.341832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142977b8-2531-4b70-a0fd-87e9e5ed625d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.341832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142977b8-2531-4b70-a0fd-87e9e5ed625d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.341832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142977b8-2531-4b70-a0fd-87e9e5ed625d None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.341832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142977b8-2531-4b70-a0fd-87e9e5ed625d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:07.341832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142977b8-2531-4b70-a0fd-87e9e5ed625d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:07.341832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142977b8-2531-4b70-a0fd-87e9e5ed625d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:07.353038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 274/551] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:07.363150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142977b8-2531-4b70-a0fd-87e9e5ed625d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.472512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cbfc6-5c63-4f3f-af68-13bd2df56706 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.513849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2adc8f-98ff-47ef-87a2-235e5979b173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.514506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2adc8f-98ff-47ef-87a2-235e5979b173 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.514898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2adc8f-98ff-47ef-87a2-235e5979b173 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.515177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2adc8f-98ff-47ef-87a2-235e5979b173 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.536096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2adc8f-98ff-47ef-87a2-235e5979b173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:07.541596 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142977b8-2531-4b70-a0fd-87e9e5ed625d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-4b2adc8f-98ff-47ef-87a2-235e5979b173 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:07.549454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:07.550423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:07.552113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 278/552] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:07.563167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2adc8f-98ff-47ef-87a2-235e5979b173 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.583276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ca288-b8b9-4b6b-889b-5ec05ac035b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.583841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ca288-b8b9-4b6b-889b-5ec05ac035b9 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.584127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ca288-b8b9-4b6b-889b-5ec05ac035b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.584408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ca288-b8b9-4b6b-889b-5ec05ac035b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.592085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ca288-b8b9-4b6b-889b-5ec05ac035b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:07.593687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ca288-b8b9-4b6b-889b-5ec05ac035b9 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-820ca288-b8b9-4b6b-889b-5ec05ac035b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:07.606587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:07.608797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:07.611183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:07.611183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:07.611183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:07.611183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:07.611183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:07.611183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:07.611183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:07.611183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:07.611183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:07.611183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:07.612449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 275/553] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:07.615232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ca288-b8b9-4b6b-889b-5ec05ac035b9 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.635196 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.698564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.764064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2adc8f-98ff-47ef-87a2-235e5979b173 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.792008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ca288-b8b9-4b6b-889b-5ec05ac035b9 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.810957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc6768-e005-4e80-9c0d-81f008e17e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.812307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc6768-e005-4e80-9c0d-81f008e17e04 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.813146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc6768-e005-4e80-9c0d-81f008e17e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.813624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc6768-e005-4e80-9c0d-81f008e17e04 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.814726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc6768-e005-4e80-9c0d-81f008e17e04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:07.815793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc6768-e005-4e80-9c0d-81f008e17e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:07.817682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc6768-e005-4e80-9c0d-81f008e17e04 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:07.832670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 279/554] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:07.837044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc6768-e005-4e80-9c0d-81f008e17e04 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.839362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e16421-673e-48e3-8fda-a1f6d2f77444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.840395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e16421-673e-48e3-8fda-a1f6d2f77444 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.841698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e16421-673e-48e3-8fda-a1f6d2f77444 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.842177 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e16421-673e-48e3-8fda-a1f6d2f77444 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.843111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e16421-673e-48e3-8fda-a1f6d2f77444 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:07.843599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e16421-673e-48e3-8fda-a1f6d2f77444 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:07.845197 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e16421-673e-48e3-8fda-a1f6d2f77444 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:07.869360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 276/555] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:07.870557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e16421-673e-48e3-8fda-a1f6d2f77444 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.947253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc6768-e005-4e80-9c0d-81f008e17e04 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.954777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.978219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.991104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e16421-673e-48e3-8fda-a1f6d2f77444 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.991890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4c609-5f1e-4702-877c-382718c3117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.992590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c609-5f1e-4702-877c-382718c3117c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.992941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c609-5f1e-4702-877c-382718c3117c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.993285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c609-5f1e-4702-877c-382718c3117c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.008225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4c609-5f1e-4702-877c-382718c3117c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-7db4c609-5f1e-4702-877c-382718c3117c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:08.014533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:08.015483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:08.016428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:08.022032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 280/556] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:08.023222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4c609-5f1e-4702-877c-382718c3117c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.042426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19bf2c-3cd9-4982-b90c-0729dc40f5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.043506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19bf2c-3cd9-4982-b90c-0729dc40f5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.044124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19bf2c-3cd9-4982-b90c-0729dc40f5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.044620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19bf2c-3cd9-4982-b90c-0729dc40f5b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.057519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19bf2c-3cd9-4982-b90c-0729dc40f5b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.059496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19bf2c-3cd9-4982-b90c-0729dc40f5b7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-1d19bf2c-3cd9-4982-b90c-0729dc40f5b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:08.076667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:08.078154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:08.079099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:08.079099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.079099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:08.086490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 277/557] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:08.087769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19bf2c-3cd9-4982-b90c-0729dc40f5b7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.151629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4c609-5f1e-4702-877c-382718c3117c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.199358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae63a8-f5cc-4733-94e6-acfc604ec9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.200117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae63a8-f5cc-4733-94e6-acfc604ec9af None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.200406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae63a8-f5cc-4733-94e6-acfc604ec9af None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.200688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae63a8-f5cc-4733-94e6-acfc604ec9af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.207411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19bf2c-3cd9-4982-b90c-0729dc40f5b7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.214303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae63a8-f5cc-4733-94e6-acfc604ec9af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.215795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae63a8-f5cc-4733-94e6-acfc604ec9af None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.231409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-afae63a8-f5cc-4733-94e6-acfc604ec9af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:08.234551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:08.235491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:08.247746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:08.247746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.247746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:08.247746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 281/558] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:08.247746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae63a8-f5cc-4733-94e6-acfc604ec9af None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.256627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67127b4-ec7e-4afa-b0e2-e401a7f0d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.257597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67127b4-ec7e-4afa-b0e2-e401a7f0d286 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.258096 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67127b4-ec7e-4afa-b0e2-e401a7f0d286 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.258600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67127b4-ec7e-4afa-b0e2-e401a7f0d286 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.259628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67127b4-ec7e-4afa-b0e2-e401a7f0d286 None admin] RBAC: Adding query filter params (name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:08.260235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67127b4-ec7e-4afa-b0e2-e401a7f0d286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.261898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67127b4-ec7e-4afa-b0e2-e401a7f0d286 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.273204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 278/559] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:08.274574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67127b4-ec7e-4afa-b0e2-e401a7f0d286 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.283774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.372784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae63a8-f5cc-4733-94e6-acfc604ec9af None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.396352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67127b4-ec7e-4afa-b0e2-e401a7f0d286 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.416123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5ad0-5cd0-4fb2-a6f0-5cbf21c62058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.416734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5ad0-5cd0-4fb2-a6f0-5cbf21c62058 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.417287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5ad0-5cd0-4fb2-a6f0-5cbf21c62058 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.417574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5ad0-5cd0-4fb2-a6f0-5cbf21c62058 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.418234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f5ad0-5cd0-4fb2-a6f0-5cbf21c62058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:08.418546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f5ad0-5cd0-4fb2-a6f0-5cbf21c62058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.419940 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f5ad0-5cd0-4fb2-a6f0-5cbf21c62058 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.435422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 282/560] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:08.436564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5ad0-5cd0-4fb2-a6f0-5cbf21c62058 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.443406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a9f30-c2ef-4be2-95df-25835f11e05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.444415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a9f30-c2ef-4be2-95df-25835f11e05b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.444922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a9f30-c2ef-4be2-95df-25835f11e05b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.445396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a9f30-c2ef-4be2-95df-25835f11e05b None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.446311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a9f30-c2ef-4be2-95df-25835f11e05b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:08.446942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a9f30-c2ef-4be2-95df-25835f11e05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.448618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a9f30-c2ef-4be2-95df-25835f11e05b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.467889 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 279/561] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:08.469161 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a9f30-c2ef-4be2-95df-25835f11e05b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.520310 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.558908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.566082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5ad0-5cd0-4fb2-a6f0-5cbf21c62058 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.587659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a9f30-c2ef-4be2-95df-25835f11e05b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.607471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686ec83-e739-40c6-8c10-ea03574e5850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.608626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686ec83-e739-40c6-8c10-ea03574e5850 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.609110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686ec83-e739-40c6-8c10-ea03574e5850 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.609693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686ec83-e739-40c6-8c10-ea03574e5850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.621617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686ec83-e739-40c6-8c10-ea03574e5850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.623196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686ec83-e739-40c6-8c10-ea03574e5850 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.626552 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5167f-be1d-42a3-bb8e-bfcbec44acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.627405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5167f-be1d-42a3-bb8e-bfcbec44acb7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.627899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5167f-be1d-42a3-bb8e-bfcbec44acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.628369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5167f-be1d-42a3-bb8e-bfcbec44acb7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.636797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5167f-be1d-42a3-bb8e-bfcbec44acb7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.638483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5167f-be1d-42a3-bb8e-bfcbec44acb7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d686ec83-e739-40c6-8c10-ea03574e5850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:08.638613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:08.639490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:08.640391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:08.640391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.640391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:08.640391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 283/562] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:08.641077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686ec83-e739-40c6-8c10-ea03574e5850 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-52d5167f-be1d-42a3-bb8e-bfcbec44acb7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:08.657108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:08.658392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:08.659587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:08.659587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:08.659587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:08.659587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:08.659587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:08.659587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:08.659587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:08.659587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:08.659587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:08.659587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:08.662333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 280/563] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:08.663724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcf4b7-0c02-4da6-8d27-1b0ed17615da None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.664017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcf4b7-0c02-4da6-8d27-1b0ed17615da None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.664294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcf4b7-0c02-4da6-8d27-1b0ed17615da None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.665555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 281/564] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:08.666281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcf4b7-0c02-4da6-8d27-1b0ed17615da None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.745609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686ec83-e739-40c6-8c10-ea03574e5850 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.770591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcf4b7-0c02-4da6-8d27-1b0ed17615da None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.772203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.779155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e4e2-e837-4a16-8feb-0b0c90b6e233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.779793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e4e2-e837-4a16-8feb-0b0c90b6e233 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.781373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e4e2-e837-4a16-8feb-0b0c90b6e233 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.781373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e4e2-e837-4a16-8feb-0b0c90b6e233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.787280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1e4e2-e837-4a16-8feb-0b0c90b6e233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.788755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1e4e2-e837-4a16-8feb-0b0c90b6e233 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-25a1e4e2-e837-4a16-8feb-0b0c90b6e233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:08.800141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:08.801920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:08.802872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:08.802872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:08.802872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:08.802872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:08.802872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:08.802872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:08.802872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:08.802872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:08.802872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 284/565] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:08.803376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbec70-3571-41f6-beff-2cc538c89f6a None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.803376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbec70-3571-41f6-beff-2cc538c89f6a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.803809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbec70-3571-41f6-beff-2cc538c89f6a None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.804858 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 285/566] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:08.805548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbec70-3571-41f6-beff-2cc538c89f6a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.806732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c60ecc-9dde-4aea-982d-180c22fe1552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.807402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c60ecc-9dde-4aea-982d-180c22fe1552 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.810062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c60ecc-9dde-4aea-982d-180c22fe1552 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.810062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c60ecc-9dde-4aea-982d-180c22fe1552 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.810062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c60ecc-9dde-4aea-982d-180c22fe1552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:08.810062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c60ecc-9dde-4aea-982d-180c22fe1552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.810385 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c60ecc-9dde-4aea-982d-180c22fe1552 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.817043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.822380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 282/567] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:08.823695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66711e-837e-49d7-af38-8941e7b65981 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.824056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66711e-837e-49d7-af38-8941e7b65981 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.824406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66711e-837e-49d7-af38-8941e7b65981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.843256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5f66711e-837e-49d7-af38-8941e7b65981 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:08.844456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5f66711e-837e-49d7-af38-8941e7b65981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:08.908327 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbec70-3571-41f6-beff-2cc538c89f6a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.910777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 283/568] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:08.911621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66711e-837e-49d7-af38-8941e7b65981 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.945241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec452d0-e298-4182-9ea0-be18e3a0891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.945951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec452d0-e298-4182-9ea0-be18e3a0891d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.946260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec452d0-e298-4182-9ea0-be18e3a0891d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.946539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec452d0-e298-4182-9ea0-be18e3a0891d None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.947259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec452d0-e298-4182-9ea0-be18e3a0891d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:08.947561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec452d0-e298-4182-9ea0-be18e3a0891d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.949009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec452d0-e298-4182-9ea0-be18e3a0891d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.966506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 286/569] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:08.967750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bd54-4f6e-4247-b1fd-5e4a53c3222a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.968038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bd54-4f6e-4247-b1fd-5e4a53c3222a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.968309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bd54-4f6e-4247-b1fd-5e4a53c3222a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.985741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a359bd54-4f6e-4247-b1fd-5e4a53c3222a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:08.986943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a359bd54-4f6e-4247-b1fd-5e4a53c3222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:09.012759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.022989 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66711e-837e-49d7-af38-8941e7b65981 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.053037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.058824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b3c9f-4296-4f17-bf7f-a412bf52cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.059440 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b3c9f-4296-4f17-bf7f-a412bf52cd23 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.059778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b3c9f-4296-4f17-bf7f-a412bf52cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.060291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 287/570] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:09.060966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bd54-4f6e-4247-b1fd-5e4a53c3222a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.068056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b3c9f-4296-4f17-bf7f-a412bf52cd23 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.073339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b3c9f-4296-4f17-bf7f-a412bf52cd23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:09.073339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b3c9f-4296-4f17-bf7f-a412bf52cd23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.073339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b3c9f-4296-4f17-bf7f-a412bf52cd23 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.087990 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 284/571] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:09.089126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b3c9f-4296-4f17-bf7f-a412bf52cd23 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.192431 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bd54-4f6e-4247-b1fd-5e4a53c3222a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.214983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b3c9f-4296-4f17-bf7f-a412bf52cd23 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.231592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b627714-1d32-47ad-849c-273eb536ece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.232225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627714-1d32-47ad-849c-273eb536ece6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.232507 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627714-1d32-47ad-849c-273eb536ece6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.232785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627714-1d32-47ad-849c-273eb536ece6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.240439 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b627714-1d32-47ad-849c-273eb536ece6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.241902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b627714-1d32-47ad-849c-273eb536ece6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.252363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c6166-3ad5-4d59-a659-a1ad3e6191a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.252971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c6166-3ad5-4d59-a659-a1ad3e6191a8 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.253255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c6166-3ad5-4d59-a659-a1ad3e6191a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6b627714-1d32-47ad-849c-273eb536ece6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:09.253355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:09.255019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:09.256690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:09.256690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:09.256690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:09.256690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:09.256690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:09.256690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:09.256690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:09.256690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:09.256690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:09.256690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:09.257592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c6166-3ad5-4d59-a659-a1ad3e6191a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.257668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 288/572] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:09.257668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b627714-1d32-47ad-849c-273eb536ece6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.283566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.317525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.336838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c6166-3ad5-4d59-a659-a1ad3e6191a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.338348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c6166-3ad5-4d59-a659-a1ad3e6191a8 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.361471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b627714-1d32-47ad-849c-273eb536ece6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.397172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3377b2-5148-4b94-9bcb-51853de8ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.397891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3377b2-5148-4b94-9bcb-51853de8ce49 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.398104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3377b2-5148-4b94-9bcb-51853de8ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.398416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3377b2-5148-4b94-9bcb-51853de8ce49 None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/9e2f71ebeca2441791a0241de737cad0/roles/0cef1088535b4535b2d6d5cc17c09549` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.412643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3377b2-5148-4b94-9bcb-51853de8ce49 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=9e2f71ebeca2441791a0241de737cad0, role_id=0cef1088535b4535b2d6d5cc17c09549)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.414104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3377b2-5148-4b94-9bcb-51853de8ce49 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.437916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 285/573] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:09.438727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c6166-3ad5-4d59-a659-a1ad3e6191a8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.479144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 289/574] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:09 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/9e2f71ebeca2441791a0241de737cad0/roles/0cef1088535b4535b2d6d5cc17c09549 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:09.480279 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3377b2-5148-4b94-9bcb-51853de8ce49 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.494583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.556490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c6166-3ad5-4d59-a659-a1ad3e6191a8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.597135 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d7fd4-1706-4bdf-9630-59aee3c87dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.598330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d7fd4-1706-4bdf-9630-59aee3c87dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.598616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d7fd4-1706-4bdf-9630-59aee3c87dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.598896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d7fd4-1706-4bdf-9630-59aee3c87dc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.602416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3377b2-5148-4b94-9bcb-51853de8ce49 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.610444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d7fd4-1706-4bdf-9630-59aee3c87dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:09.612970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-3b9d7fd4-1706-4bdf-9630-59aee3c87dc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:09.615779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:09.616704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:09.617560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 286/575] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:09.618294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d7fd4-1706-4bdf-9630-59aee3c87dc4 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.652050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a19e4a-4730-487e-ba15-2a29a389ce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.652672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a19e4a-4730-487e-ba15-2a29a389ce8e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.653217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a19e4a-4730-487e-ba15-2a29a389ce8e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.653655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a19e4a-4730-487e-ba15-2a29a389ce8e None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.654796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a19e4a-4730-487e-ba15-2a29a389ce8e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:09.655107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a19e4a-4730-487e-ba15-2a29a389ce8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.656580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a19e4a-4730-487e-ba15-2a29a389ce8e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.675510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 290/576] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:09.676428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a19e4a-4730-487e-ba15-2a29a389ce8e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.733429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d7fd4-1706-4bdf-9630-59aee3c87dc4 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.749451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.772268 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c910-906c-4f23-88fd-c98caf19dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.773862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c910-906c-4f23-88fd-c98caf19dd3c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.773862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c910-906c-4f23-88fd-c98caf19dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.773862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c910-906c-4f23-88fd-c98caf19dd3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.784732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591c910-906c-4f23-88fd-c98caf19dd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-2591c910-906c-4f23-88fd-c98caf19dd3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:09.790613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:09.791615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:09.795436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 287/577] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:09.796181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a19e4a-4730-487e-ba15-2a29a389ce8e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.796259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c910-906c-4f23-88fd-c98caf19dd3c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.833394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb315631-a687-4600-93ab-c97ed8d01ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.834578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb315631-a687-4600-93ab-c97ed8d01ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.834932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb315631-a687-4600-93ab-c97ed8d01ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.835216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb315631-a687-4600-93ab-c97ed8d01ae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.846634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb315631-a687-4600-93ab-c97ed8d01ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.849117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb315631-a687-4600-93ab-c97ed8d01ae9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-cb315631-a687-4600-93ab-c97ed8d01ae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:09.865901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:09.867115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:09.868185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:09.868185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:09.868185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:09.868185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 291/578] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:09.868185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb315631-a687-4600-93ab-c97ed8d01ae9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.890254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.900773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c910-906c-4f23-88fd-c98caf19dd3c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.941172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d129c0-9ff6-433e-adf0-bec529254826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.942344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d129c0-9ff6-433e-adf0-bec529254826 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.942629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d129c0-9ff6-433e-adf0-bec529254826 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.942899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d129c0-9ff6-433e-adf0-bec529254826 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.943568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d129c0-9ff6-433e-adf0-bec529254826 None admin] RBAC: Adding query filter params (name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:09.943871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d129c0-9ff6-433e-adf0-bec529254826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.945253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d129c0-9ff6-433e-adf0-bec529254826 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.953803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 288/579] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:09.954635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d129c0-9ff6-433e-adf0-bec529254826 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.985764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb315631-a687-4600-93ab-c97ed8d01ae9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.991678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.022971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ccc5-f01a-4823-b118-44cdbc0fe69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.023606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ccc5-f01a-4823-b118-44cdbc0fe69f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.023887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ccc5-f01a-4823-b118-44cdbc0fe69f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.024204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ccc5-f01a-4823-b118-44cdbc0fe69f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.034698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5ccc5-f01a-4823-b118-44cdbc0fe69f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.036238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5ccc5-f01a-4823-b118-44cdbc0fe69f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f3d5ccc5-f01a-4823-b118-44cdbc0fe69f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:10.050523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:10.052079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:10.053652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:10.053652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:10.053652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:10.053652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 292/580] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:10.053652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ccc5-f01a-4823-b118-44cdbc0fe69f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.067144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d129c0-9ff6-433e-adf0-bec529254826 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.105048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea106407-fce3-4d7d-b210-ea634f37cd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.106227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea106407-fce3-4d7d-b210-ea634f37cd56 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.107082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea106407-fce3-4d7d-b210-ea634f37cd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.107545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea106407-fce3-4d7d-b210-ea634f37cd56 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.108426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea106407-fce3-4d7d-b210-ea634f37cd56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.108964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea106407-fce3-4d7d-b210-ea634f37cd56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.111350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea106407-fce3-4d7d-b210-ea634f37cd56 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.124510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.130290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 289/581] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.130290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea106407-fce3-4d7d-b210-ea634f37cd56 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.166615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ccc5-f01a-4823-b118-44cdbc0fe69f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.203002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd43a8a-777a-46bf-917f-75e1d124b08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.203714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd43a8a-777a-46bf-917f-75e1d124b08e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.204001 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd43a8a-777a-46bf-917f-75e1d124b08e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.204277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd43a8a-777a-46bf-917f-75e1d124b08e None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.204924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd43a8a-777a-46bf-917f-75e1d124b08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.205232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd43a8a-777a-46bf-917f-75e1d124b08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.206986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd43a8a-777a-46bf-917f-75e1d124b08e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.222969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 293/582] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.222969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd43a8a-777a-46bf-917f-75e1d124b08e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.239203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.244891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea106407-fce3-4d7d-b210-ea634f37cd56 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.282778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb7185-8d06-4edb-afa7-b73c640d7492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.283410 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb7185-8d06-4edb-afa7-b73c640d7492 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.283694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb7185-8d06-4edb-afa7-b73c640d7492 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.284000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb7185-8d06-4edb-afa7-b73c640d7492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.295890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb7185-8d06-4edb-afa7-b73c640d7492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.297394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb7185-8d06-4edb-afa7-b73c640d7492 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-ccfb7185-8d06-4edb-afa7-b73c640d7492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:10.311726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:10.312674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:10.313556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:10.313556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:10.313556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:10.313556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 290/583] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:10.313556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb7185-8d06-4edb-afa7-b73c640d7492 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.335163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd43a8a-777a-46bf-917f-75e1d124b08e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.364435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.372748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777335-6ff9-436d-82ab-251f699a9c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.393894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777335-6ff9-436d-82ab-251f699a9c8f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.393894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777335-6ff9-436d-82ab-251f699a9c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.393894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777335-6ff9-436d-82ab-251f699a9c8f None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.393894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f777335-6ff9-436d-82ab-251f699a9c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.393894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f777335-6ff9-436d-82ab-251f699a9c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.393894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f777335-6ff9-436d-82ab-251f699a9c8f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.394420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 294/584] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.394420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777335-6ff9-436d-82ab-251f699a9c8f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.422938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb7185-8d06-4edb-afa7-b73c640d7492 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.461828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f120d-b857-446b-b31d-9ddb0a314e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.462534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f120d-b857-446b-b31d-9ddb0a314e3f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.462749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f120d-b857-446b-b31d-9ddb0a314e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.463013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f120d-b857-446b-b31d-9ddb0a314e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.475006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f120d-b857-446b-b31d-9ddb0a314e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.476465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f120d-b857-446b-b31d-9ddb0a314e3f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.485756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-7f9f120d-b857-446b-b31d-9ddb0a314e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:10.496353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:10.497374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:10.498348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:10.498348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:10.498348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:10.498348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 291/585] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:10.498348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f120d-b857-446b-b31d-9ddb0a314e3f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.512032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777335-6ff9-436d-82ab-251f699a9c8f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.549708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf9c06-efd5-4739-b0df-9aa786dbcb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.550499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9c06-efd5-4739-b0df-9aa786dbcb21 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.550931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9c06-efd5-4739-b0df-9aa786dbcb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.551276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9c06-efd5-4739-b0df-9aa786dbcb21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.558220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf9c06-efd5-4739-b0df-9aa786dbcb21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.559799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf9c06-efd5-4739-b0df-9aa786dbcb21 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-8ddf9c06-efd5-4739-b0df-9aa786dbcb21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:10.573887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:10.575097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:10.576016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:10.576016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:10.576016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:10.576016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:10.576016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:10.576016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:10.576016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:10.576016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:10.576016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 295/586] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:10.576513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf9c06-efd5-4739-b0df-9aa786dbcb21 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.633350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.638427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f120d-b857-446b-b31d-9ddb0a314e3f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.673506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405665-1bcb-46a4-ad70-429beca76a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.674114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405665-1bcb-46a4-ad70-429beca76a8d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.674424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405665-1bcb-46a4-ad70-429beca76a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.674702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405665-1bcb-46a4-ad70-429beca76a8d None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.675345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405665-1bcb-46a4-ad70-429beca76a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.675653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405665-1bcb-46a4-ad70-429beca76a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.677265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405665-1bcb-46a4-ad70-429beca76a8d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.690728 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 292/587] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.692154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405665-1bcb-46a4-ad70-429beca76a8d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.700002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf9c06-efd5-4739-b0df-9aa786dbcb21 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.740613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c30974-452b-49f4-ab81-f6d3a96f6b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.741254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c30974-452b-49f4-ab81-f6d3a96f6b64 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.741543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c30974-452b-49f4-ab81-f6d3a96f6b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.741828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c30974-452b-49f4-ab81-f6d3a96f6b64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.750569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c30974-452b-49f4-ab81-f6d3a96f6b64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.752165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c30974-452b-49f4-ab81-f6d3a96f6b64 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.756014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-19c30974-452b-49f4-ab81-f6d3a96f6b64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:10.766978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:10.777435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:10.778548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:10.778548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:10.778548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:10.778548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:10.778548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:10.778548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:10.778548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:10.778548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:10.778548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 296/588] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:10.778548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c30974-452b-49f4-ab81-f6d3a96f6b64 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.801411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405665-1bcb-46a4-ad70-429beca76a8d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.841051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab7458-6b4e-41e8-b810-c5247c2800c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.841665 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab7458-6b4e-41e8-b810-c5247c2800c6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.841952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab7458-6b4e-41e8-b810-c5247c2800c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.842258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab7458-6b4e-41e8-b810-c5247c2800c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.842887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab7458-6b4e-41e8-b810-c5247c2800c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.843195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab7458-6b4e-41e8-b810-c5247c2800c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.844586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab7458-6b4e-41e8-b810-c5247c2800c6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.856796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 293/589] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.857493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab7458-6b4e-41e8-b810-c5247c2800c6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.889845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c30974-452b-49f4-ab81-f6d3a96f6b64 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.899733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.925542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c195150-a5d9-416b-9ddc-7e4639633fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.926800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c195150-a5d9-416b-9ddc-7e4639633fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.927149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c195150-a5d9-416b-9ddc-7e4639633fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.927482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c195150-a5d9-416b-9ddc-7e4639633fc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.928273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c195150-a5d9-416b-9ddc-7e4639633fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.928644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c195150-a5d9-416b-9ddc-7e4639633fc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.930138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c195150-a5d9-416b-9ddc-7e4639633fc9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.947600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 297/590] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.947600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c195150-a5d9-416b-9ddc-7e4639633fc9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.971289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab7458-6b4e-41e8-b810-c5247c2800c6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.994679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.009270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ce610-a912-48c2-887f-957631f19243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.010094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ce610-a912-48c2-887f-957631f19243 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.010476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ce610-a912-48c2-887f-957631f19243 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.010754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ce610-a912-48c2-887f-957631f19243 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.020281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ce610-a912-48c2-887f-957631f19243 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.021844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ce610-a912-48c2-887f-957631f19243 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-609ce610-a912-48c2-887f-957631f19243 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:11.033062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:11.034072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 294/591] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:11.035065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ce610-a912-48c2-887f-957631f19243 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.050048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c195150-a5d9-416b-9ddc-7e4639633fc9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.087443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05415b58-7742-4994-8c88-bfa76189bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.088050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05415b58-7742-4994-8c88-bfa76189bff6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.088328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05415b58-7742-4994-8c88-bfa76189bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.088604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05415b58-7742-4994-8c88-bfa76189bff6 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.089292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05415b58-7742-4994-8c88-bfa76189bff6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:11.089599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05415b58-7742-4994-8c88-bfa76189bff6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.091076 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05415b58-7742-4994-8c88-bfa76189bff6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.108280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 298/592] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:11.108280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05415b58-7742-4994-8c88-bfa76189bff6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.134116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.151084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ce610-a912-48c2-887f-957631f19243 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.187712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424bd7-642f-4cf1-adba-3bed23c8a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.188690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424bd7-642f-4cf1-adba-3bed23c8a039 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.189156 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424bd7-642f-4cf1-adba-3bed23c8a039 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.189612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424bd7-642f-4cf1-adba-3bed23c8a039 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.198930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69424bd7-642f-4cf1-adba-3bed23c8a039 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.200580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69424bd7-642f-4cf1-adba-3bed23c8a039 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-69424bd7-642f-4cf1-adba-3bed23c8a039 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:11.212488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:11.213456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:11.214449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:11.214449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:11.214449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:11.214449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:11.214449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:11.214449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:11.214449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:11.214449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:11.214449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:11.214449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:11.215977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05415b58-7742-4994-8c88-bfa76189bff6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.216424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 295/593] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:11.217327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424bd7-642f-4cf1-adba-3bed23c8a039 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.256168 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aabe52-6c88-487d-8c53-e2e4c35003a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.256792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aabe52-6c88-487d-8c53-e2e4c35003a2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.257079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aabe52-6c88-487d-8c53-e2e4c35003a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.257362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aabe52-6c88-487d-8c53-e2e4c35003a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.258103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aabe52-6c88-487d-8c53-e2e4c35003a2 None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=656ce4b09cf6425193b7e58562ccaced) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:11.258465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aabe52-6c88-487d-8c53-e2e4c35003a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.259982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aabe52-6c88-487d-8c53-e2e4c35003a2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.265704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.269978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 299/594] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/role_assignments?user.id=656ce4b09cf6425193b7e58562ccaced&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:11.271047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aabe52-6c88-487d-8c53-e2e4c35003a2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.348693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424bd7-642f-4cf1-adba-3bed23c8a039 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.387828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c07ae-220d-4cfa-8de1-70c5712609ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.388557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c07ae-220d-4cfa-8de1-70c5712609ba None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.388950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c07ae-220d-4cfa-8de1-70c5712609ba None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.389309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c07ae-220d-4cfa-8de1-70c5712609ba None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.390179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c07ae-220d-4cfa-8de1-70c5712609ba None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:11.390589 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c07ae-220d-4cfa-8de1-70c5712609ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.392375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c07ae-220d-4cfa-8de1-70c5712609ba None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.400246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.414343 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aabe52-6c88-487d-8c53-e2e4c35003a2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.418107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 296/595] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:11.419157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c07ae-220d-4cfa-8de1-70c5712609ba None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.454976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035e8c-43b7-4e11-991f-0a9ff91f4e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.455698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035e8c-43b7-4e11-991f-0a9ff91f4e65 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.455925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035e8c-43b7-4e11-991f-0a9ff91f4e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.456205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035e8c-43b7-4e11-991f-0a9ff91f4e65 None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/a3e56c9d900f4e4e91ea944d4cb0a40a/roles/0cef1088535b4535b2d6d5cc17c09549` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.472099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035e8c-43b7-4e11-991f-0a9ff91f4e65 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=a3e56c9d900f4e4e91ea944d4cb0a40a, role_id=0cef1088535b4535b2d6d5cc17c09549)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.473819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035e8c-43b7-4e11-991f-0a9ff91f4e65 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.522935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.527118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c07ae-220d-4cfa-8de1-70c5712609ba None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.554616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 300/596] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:11 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/a3e56c9d900f4e4e91ea944d4cb0a40a/roles/0cef1088535b4535b2d6d5cc17c09549 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:11.555462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035e8c-43b7-4e11-991f-0a9ff91f4e65 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.575097 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ef7ec-72c9-48a6-920e-93574e25e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.576214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ef7ec-72c9-48a6-920e-93574e25e292 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.576499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ef7ec-72c9-48a6-920e-93574e25e292 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.576769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ef7ec-72c9-48a6-920e-93574e25e292 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.577571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ef7ec-72c9-48a6-920e-93574e25e292 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:11.577880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ef7ec-72c9-48a6-920e-93574e25e292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.579618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ef7ec-72c9-48a6-920e-93574e25e292 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.605847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 297/597] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:11.605847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83463b7e-ce42-470b-b9bf-a8876c5da0df None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.605847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83463b7e-ce42-470b-b9bf-a8876c5da0df None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.605847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83463b7e-ce42-470b-b9bf-a8876c5da0df None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.605847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 298/598] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:11.611834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83463b7e-ce42-470b-b9bf-a8876c5da0df None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.719707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035e8c-43b7-4e11-991f-0a9ff91f4e65 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.733571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83463b7e-ce42-470b-b9bf-a8876c5da0df None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.764802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b3b84-cca1-461a-9735-d0a0ed7cce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.765436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b3b84-cca1-461a-9735-d0a0ed7cce78 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.765715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b3b84-cca1-461a-9735-d0a0ed7cce78 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.766037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b3b84-cca1-461a-9735-d0a0ed7cce78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.773267 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341376a-2402-40e9-91b3-37262860d8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.773839 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341376a-2402-40e9-91b3-37262860d8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.774135 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341376a-2402-40e9-91b3-37262860d8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.774438 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341376a-2402-40e9-91b3-37262860d8f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.781266 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b3b84-cca1-461a-9735-d0a0ed7cce78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.782933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b3b84-cca1-461a-9735-d0a0ed7cce78 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.785007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.786773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341376a-2402-40e9-91b3-37262860d8f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.788214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341376a-2402-40e9-91b3-37262860d8f6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-3341376a-2402-40e9-91b3-37262860d8f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:11.803614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:11.804702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:11.805591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:11.805591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:11.805591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-5f6b3b84-cca1-461a-9735-d0a0ed7cce78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:11.805760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:11.806638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:11.807543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:11.807543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:11.807543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:11.807543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 301/600] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:11.807543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a456-14ad-4454-9599-320198385cae None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.807838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a456-14ad-4454-9599-320198385cae None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.808174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a456-14ad-4454-9599-320198385cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.808931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 299/600] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:11.810961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341376a-2402-40e9-91b3-37262860d8f6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.830583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.832955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-19e8a456-14ad-4454-9599-320198385cae None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:11.834505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-19e8a456-14ad-4454-9599-320198385cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:11.907462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 302/601] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:11.908523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8a456-14ad-4454-9599-320198385cae None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.943759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341376a-2402-40e9-91b3-37262860d8f6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.980557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693a269-c95d-491b-9534-69e2481e3f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.981260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693a269-c95d-491b-9534-69e2481e3f16 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.981691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693a269-c95d-491b-9534-69e2481e3f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.982035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693a269-c95d-491b-9534-69e2481e3f16 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.982762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693a269-c95d-491b-9534-69e2481e3f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:11.983130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693a269-c95d-491b-9534-69e2481e3f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.984609 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693a269-c95d-491b-9534-69e2481e3f16 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.001765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 300/602] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:12.003097 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693a269-c95d-491b-9534-69e2481e3f16 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.034640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8a456-14ad-4454-9599-320198385cae None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.060271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.072410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f92a0-30f8-4a34-a921-1ed1ff9424a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.073249 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f92a0-30f8-4a34-a921-1ed1ff9424a4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.073624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f92a0-30f8-4a34-a921-1ed1ff9424a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.073994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f92a0-30f8-4a34-a921-1ed1ff9424a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.074797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f92a0-30f8-4a34-a921-1ed1ff9424a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:12.075229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f92a0-30f8-4a34-a921-1ed1ff9424a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.076764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f92a0-30f8-4a34-a921-1ed1ff9424a4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.085816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.089271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 303/603] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:12.094351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f92a0-30f8-4a34-a921-1ed1ff9424a4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.152620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693a269-c95d-491b-9534-69e2481e3f16 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.213224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f92a0-30f8-4a34-a921-1ed1ff9424a4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.236801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943676-4b90-47a5-9762-20053c5e8b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.237503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943676-4b90-47a5-9762-20053c5e8b11 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.237783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943676-4b90-47a5-9762-20053c5e8b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.238054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943676-4b90-47a5-9762-20053c5e8b11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.255288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d9c6-0929-4a1b-8708-5c42f9df3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.256377 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9943676-4b90-47a5-9762-20053c5e8b11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.257852 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9943676-4b90-47a5-9762-20053c5e8b11 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.258722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d9c6-0929-4a1b-8708-5c42f9df3d1c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.259008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d9c6-0929-4a1b-8708-5c42f9df3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.259288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d9c6-0929-4a1b-8708-5c42f9df3d1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.274881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d9c6-0929-4a1b-8708-5c42f9df3d1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-d9943676-4b90-47a5-9762-20053c5e8b11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:12.280446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:12.281345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:12.282271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:12.282271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:12.282271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:12.282271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:12.282271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:12.282271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:12.282271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:12.282271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:12.282716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d9c6-0929-4a1b-8708-5c42f9df3d1c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.293048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 301/604] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f151d9c6-0929-4a1b-8708-5c42f9df3d1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:12.299811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:12.302337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:12.304474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:12.304474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:12.304474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:12.304474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:12.304474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:12.304474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:12.304474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:12.304474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:12.304474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 304/605] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:12.305624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943676-4b90-47a5-9762-20053c5e8b11 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.312475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d9c6-0929-4a1b-8708-5c42f9df3d1c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.387408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.437447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943676-4b90-47a5-9762-20053c5e8b11 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.456789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d9c6-0929-4a1b-8708-5c42f9df3d1c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.470746 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.480992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572e44a-8b6b-4534-a503-67624053673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.481875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572e44a-8b6b-4534-a503-67624053673a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.482160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572e44a-8b6b-4534-a503-67624053673a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.482484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572e44a-8b6b-4534-a503-67624053673a None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.483164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572e44a-8b6b-4534-a503-67624053673a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:12.486257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572e44a-8b6b-4534-a503-67624053673a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.486257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572e44a-8b6b-4534-a503-67624053673a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.497227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcca983-7508-4a4e-94bd-193246caf37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.498110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcca983-7508-4a4e-94bd-193246caf37b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.498640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcca983-7508-4a4e-94bd-193246caf37b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.499094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcca983-7508-4a4e-94bd-193246caf37b None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.499955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcca983-7508-4a4e-94bd-193246caf37b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:12.500447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcca983-7508-4a4e-94bd-193246caf37b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.501797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 302/606] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:12.502428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcca983-7508-4a4e-94bd-193246caf37b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.506983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572e44a-8b6b-4534-a503-67624053673a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.519676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 305/607] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:12.520907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcca983-7508-4a4e-94bd-193246caf37b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.635373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcca983-7508-4a4e-94bd-193246caf37b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.639443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.653635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572e44a-8b6b-4534-a503-67624053673a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.673560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e8a8c-94f5-47e1-aaf8-9bf5aac21a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.674613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e8a8c-94f5-47e1-aaf8-9bf5aac21a22 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.675102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e8a8c-94f5-47e1-aaf8-9bf5aac21a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.675591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e8a8c-94f5-47e1-aaf8-9bf5aac21a22 None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/948a5df1d4244c839a7faeb54f93dfbb/roles/0cef1088535b4535b2d6d5cc17c09549` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.691988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e8a8c-94f5-47e1-aaf8-9bf5aac21a22 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=948a5df1d4244c839a7faeb54f93dfbb, role_id=0cef1088535b4535b2d6d5cc17c09549)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.693908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e8a8c-94f5-47e1-aaf8-9bf5aac21a22 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.696771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32b23-7ee4-4ccf-a81c-d36fedf892a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.697411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32b23-7ee4-4ccf-a81c-d36fedf892a5 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.697735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32b23-7ee4-4ccf-a81c-d36fedf892a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.698037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32b23-7ee4-4ccf-a81c-d36fedf892a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.710054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be32b23-7ee4-4ccf-a81c-d36fedf892a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-3be32b23-7ee4-4ccf-a81c-d36fedf892a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:12.714551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:12.715636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:12.716498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 303/608] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:12.717224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32b23-7ee4-4ccf-a81c-d36fedf892a5 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.764715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 306/609] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:12 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/948a5df1d4244c839a7faeb54f93dfbb/roles/0cef1088535b4535b2d6d5cc17c09549 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:12.766469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e8a8c-94f5-47e1-aaf8-9bf5aac21a22 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.789636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.903601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e8a8c-94f5-47e1-aaf8-9bf5aac21a22 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.915571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32b23-7ee4-4ccf-a81c-d36fedf892a5 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.951682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4261-8fd1-4737-b36b-e8a95ad750ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.952470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4261-8fd1-4737-b36b-e8a95ad750ae None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.952888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4261-8fd1-4737-b36b-e8a95ad750ae None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.953163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4261-8fd1-4737-b36b-e8a95ad750ae None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.953982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4261-8fd1-4737-b36b-e8a95ad750ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:12.955217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4261-8fd1-4737-b36b-e8a95ad750ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.956051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4261-8fd1-4737-b36b-e8a95ad750ae None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.967312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 307/610] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:12.972992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4261-8fd1-4737-b36b-e8a95ad750ae None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.978771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66401-4698-4be6-83e4-bc60c482b17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.979496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66401-4698-4be6-83e4-bc60c482b17a None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.979782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66401-4698-4be6-83e4-bc60c482b17a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.980062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66401-4698-4be6-83e4-bc60c482b17a None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/80696f8fcd8e4d01b303bdfd81a6dc9f/roles/0cef1088535b4535b2d6d5cc17c09549` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.993625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.996005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae66401-4698-4be6-83e4-bc60c482b17a None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=80696f8fcd8e4d01b303bdfd81a6dc9f, role_id=0cef1088535b4535b2d6d5cc17c09549)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.997512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae66401-4698-4be6-83e4-bc60c482b17a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:13.087530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4261-8fd1-4737-b36b-e8a95ad750ae None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:13.105888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 304/611] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:12 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/80696f8fcd8e4d01b303bdfd81a6dc9f/roles/0cef1088535b4535b2d6d5cc17c09549 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:13.133767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4eb2f-39a8-4737-9c3c-2fd1c369e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:13.134518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4eb2f-39a8-4737-9c3c-2fd1c369e053 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.134807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4eb2f-39a8-4737-9c3c-2fd1c369e053 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.135081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4eb2f-39a8-4737-9c3c-2fd1c369e053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.149217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4eb2f-39a8-4737-9c3c-2fd1c369e053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:13.150794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4eb2f-39a8-4737-9c3c-2fd1c369e053 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-25c4eb2f-39a8-4737-9c3c-2fd1c369e053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:13.167436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:13.168409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:13.169936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:13.169936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:13.169936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:13.169936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 308/612] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:13.174488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66401-4698-4be6-83e4-bc60c482b17a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:13.344763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3eb66-a920-4872-ac40-b40269db91bb None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.345091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3eb66-a920-4872-ac40-b40269db91bb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.345322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3eb66-a920-4872-ac40-b40269db91bb None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.350232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 309/613] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:13.352293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8045490-4dd6-47f3-a5af-72edf67a43c9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.352577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8045490-4dd6-47f3-a5af-72edf67a43c9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.352848 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8045490-4dd6-47f3-a5af-72edf67a43c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.364697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:13.368710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66401-4698-4be6-83e4-bc60c482b17a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:13.378277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c8045490-4dd6-47f3-a5af-72edf67a43c9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:13.383506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c8045490-4dd6-47f3-a5af-72edf67a43c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:13.409338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fda22-17ff-4aae-8349-8606e7ad886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:13.410831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fda22-17ff-4aae-8349-8606e7ad886f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.411123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fda22-17ff-4aae-8349-8606e7ad886f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.411395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fda22-17ff-4aae-8349-8606e7ad886f None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.412042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fda22-17ff-4aae-8349-8606e7ad886f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:13.412345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fda22-17ff-4aae-8349-8606e7ad886f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:13.414281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fda22-17ff-4aae-8349-8606e7ad886f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:13.427765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 305/614] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:13.433298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fda22-17ff-4aae-8349-8606e7ad886f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:13.506545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:13.517619 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 310/615] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:13.600684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fda22-17ff-4aae-8349-8606e7ad886f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:13.645471 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeea81-f679-4236-be4a-ecda2d573589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:13.646105 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeea81-f679-4236-be4a-ecda2d573589 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.646411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeea81-f679-4236-be4a-ecda2d573589 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.646686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeea81-f679-4236-be4a-ecda2d573589 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.657246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeea81-f679-4236-be4a-ecda2d573589 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:13.658733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeea81-f679-4236-be4a-ecda2d573589 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-0cfeea81-f679-4236-be4a-ecda2d573589 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:13.673218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:13.674238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:13.675235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 306/616] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:13.680526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8045490-4dd6-47f3-a5af-72edf67a43c9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:13.786330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8045490-4dd6-47f3-a5af-72edf67a43c9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:13.810288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d68c-4b59-4a8b-b17e-4b3ca01ec276 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.810719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d68c-4b59-4a8b-b17e-4b3ca01ec276 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.811094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d68c-4b59-4a8b-b17e-4b3ca01ec276 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.813473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 307/617] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:13.818838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20557e-5f1e-4e7f-ae07-3467c6b57990 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.819119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20557e-5f1e-4e7f-ae07-3467c6b57990 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.819391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20557e-5f1e-4e7f-ae07-3467c6b57990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.833976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ecb26-8ea7-4dea-b003-088f141dea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:13.834630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ecb26-8ea7-4dea-b003-088f141dea75 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.834910 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ecb26-8ea7-4dea-b003-088f141dea75 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.835184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ecb26-8ea7-4dea-b003-088f141dea75 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.835925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ecb26-8ea7-4dea-b003-088f141dea75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:13.836233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ecb26-8ea7-4dea-b003-088f141dea75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:13.837694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ecb26-8ea7-4dea-b003-088f141dea75 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:13.862498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-bb20557e-5f1e-4e7f-ae07-3467c6b57990 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:13.863858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bb20557e-5f1e-4e7f-ae07-3467c6b57990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:13.866481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 311/618] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:13.873510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ecb26-8ea7-4dea-b003-088f141dea75 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:13.894174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:13.969375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:13.978397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 308/619] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:13.979725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20557e-5f1e-4e7f-ae07-3467c6b57990 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.049637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ecb26-8ea7-4dea-b003-088f141dea75 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.134902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb0275-0178-4bf6-9b39-6354cd37fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.135528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0275-0178-4bf6-9b39-6354cd37fe25 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.135810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0275-0178-4bf6-9b39-6354cd37fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.136083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0275-0178-4bf6-9b39-6354cd37fe25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.199705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20557e-5f1e-4e7f-ae07-3467c6b57990 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.257337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a413-251d-4fb3-946b-7a9340cd5da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.259413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a413-251d-4fb3-946b-7a9340cd5da3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.259697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a413-251d-4fb3-946b-7a9340cd5da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.259976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a413-251d-4fb3-946b-7a9340cd5da3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.276945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64a413-251d-4fb3-946b-7a9340cd5da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:14.282518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb0275-0178-4bf6-9b39-6354cd37fe25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-8e64a413-251d-4fb3-946b-7a9340cd5da3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:14.282652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:14.283846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:14.285128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:14.285841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb0275-0178-4bf6-9b39-6354cd37fe25 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.285940 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 309/620] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:14.285940 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a413-251d-4fb3-946b-7a9340cd5da3 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.301028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.350532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.416385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 312/621] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:27:14.416385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb0275-0178-4bf6-9b39-6354cd37fe25 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.420406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a413-251d-4fb3-946b-7a9340cd5da3 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.460938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f7923-b48c-4723-8593-86607715098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.462124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f7923-b48c-4723-8593-86607715098f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.462665 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f7923-b48c-4723-8593-86607715098f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.463157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f7923-b48c-4723-8593-86607715098f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.476064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f7923-b48c-4723-8593-86607715098f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-0d9f7923-b48c-4723-8593-86607715098f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:14.481507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:14.482464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:14.483301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:14.491846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 310/622] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:14.493101 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f7923-b48c-4723-8593-86607715098f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.530512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb0275-0178-4bf6-9b39-6354cd37fe25 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.566640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcb78f-a1bd-4e7f-b03b-ca6ecf2c5ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.567298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcb78f-a1bd-4e7f-b03b-ca6ecf2c5ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.567580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcb78f-a1bd-4e7f-b03b-ca6ecf2c5ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.567857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcb78f-a1bd-4e7f-b03b-ca6ecf2c5ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.568527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcb78f-a1bd-4e7f-b03b-ca6ecf2c5ec7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:14.568829 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcb78f-a1bd-4e7f-b03b-ca6ecf2c5ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.569890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.570282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcb78f-a1bd-4e7f-b03b-ca6ecf2c5ec7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.580653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 313/623] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:14.581544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcb78f-a1bd-4e7f-b03b-ca6ecf2c5ec7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.602495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.611212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f7923-b48c-4723-8593-86607715098f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.650395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008bda9-89d5-4392-916c-4141b8223037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.651445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008bda9-89d5-4392-916c-4141b8223037 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.651922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008bda9-89d5-4392-916c-4141b8223037 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.652403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008bda9-89d5-4392-916c-4141b8223037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.663943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008bda9-89d5-4392-916c-4141b8223037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.666136 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008bda9-89d5-4392-916c-4141b8223037 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-0008bda9-89d5-4392-916c-4141b8223037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:14.683444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:14.684469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:14.685400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:14.685400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:14.685400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:14.687063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 311/624] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:14.687976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008bda9-89d5-4392-916c-4141b8223037 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.688316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcb78f-a1bd-4e7f-b03b-ca6ecf2c5ec7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.725358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee8d98-77c1-447b-8f8f-6921d705757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.726034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee8d98-77c1-447b-8f8f-6921d705757a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.726354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee8d98-77c1-447b-8f8f-6921d705757a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.726632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee8d98-77c1-447b-8f8f-6921d705757a None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.727297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee8d98-77c1-447b-8f8f-6921d705757a None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:14.727603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee8d98-77c1-447b-8f8f-6921d705757a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.729058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee8d98-77c1-447b-8f8f-6921d705757a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.742858 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 314/625] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:14.742858 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee8d98-77c1-447b-8f8f-6921d705757a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.807380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008bda9-89d5-4392-916c-4141b8223037 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.825707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.830995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.846253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee8d98-77c1-447b-8f8f-6921d705757a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.848024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f9af7-5dba-4b74-9dd1-409b72c0c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.849071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f9af7-5dba-4b74-9dd1-409b72c0c695 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.849511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f9af7-5dba-4b74-9dd1-409b72c0c695 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.849950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f9af7-5dba-4b74-9dd1-409b72c0c695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.861401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f9af7-5dba-4b74-9dd1-409b72c0c695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.863146 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f9af7-5dba-4b74-9dd1-409b72c0c695 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-2f6f9af7-5dba-4b74-9dd1-409b72c0c695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:14.880796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:14.881983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:14.883042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:14.883042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:14.883042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:14.883571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171235-2eb6-4222-b802-3a79d0912d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.884238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171235-2eb6-4222-b802-3a79d0912d67 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.884529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171235-2eb6-4222-b802-3a79d0912d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.884807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171235-2eb6-4222-b802-3a79d0912d67 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.885406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 312/626] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:14.885516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50171235-2eb6-4222-b802-3a79d0912d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:14.885742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50171235-2eb6-4222-b802-3a79d0912d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.886715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f9af7-5dba-4b74-9dd1-409b72c0c695 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.887310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50171235-2eb6-4222-b802-3a79d0912d67 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.900633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 315/627] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:14.901491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171235-2eb6-4222-b802-3a79d0912d67 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.997600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f9af7-5dba-4b74-9dd1-409b72c0c695 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.012643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171235-2eb6-4222-b802-3a79d0912d67 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.036413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dee278-1123-49ed-a671-7b61555624f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.037041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dee278-1123-49ed-a671-7b61555624f2 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.037325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dee278-1123-49ed-a671-7b61555624f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.037607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dee278-1123-49ed-a671-7b61555624f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.047990 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dee278-1123-49ed-a671-7b61555624f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.049516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dee278-1123-49ed-a671-7b61555624f2 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.052334 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c5c56-729d-4738-bc90-2efdfcdf4b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.053240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c5c56-729d-4738-bc90-2efdfcdf4b0a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.053677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c5c56-729d-4738-bc90-2efdfcdf4b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.054107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c5c56-729d-4738-bc90-2efdfcdf4b0a None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.054993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c5c56-729d-4738-bc90-2efdfcdf4b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:15.055500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c5c56-729d-4738-bc90-2efdfcdf4b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.057137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c5c56-729d-4738-bc90-2efdfcdf4b0a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-d7dee278-1123-49ed-a671-7b61555624f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:15.064209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:15.065719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:15.066929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:15.066929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:15.066929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:15.066929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 313/628] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:15.069581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.071817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dee278-1123-49ed-a671-7b61555624f2 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.072900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 316/629] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:15.074180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929e2af-1a14-4574-8507-93b3a13a5d7f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.074499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929e2af-1a14-4574-8507-93b3a13a5d7f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.074778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929e2af-1a14-4574-8507-93b3a13a5d7f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.080277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 317/630] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:15.080277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929e2af-1a14-4574-8507-93b3a13a5d7f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.105352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.186264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dee278-1123-49ed-a671-7b61555624f2 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.193218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929e2af-1a14-4574-8507-93b3a13a5d7f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.221834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081ae2f-716e-457b-b245-a1146c1e8c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.222590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081ae2f-716e-457b-b245-a1146c1e8c55 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.222936 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081ae2f-716e-457b-b245-a1146c1e8c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.223277 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081ae2f-716e-457b-b245-a1146c1e8c55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.230212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c948-ea93-424f-ad32-4ba80c8d36b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.230380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081ae2f-716e-457b-b245-a1146c1e8c55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.230832 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c948-ea93-424f-ad32-4ba80c8d36b4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.231112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c948-ea93-424f-ad32-4ba80c8d36b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.231386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c948-ea93-424f-ad32-4ba80c8d36b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.231937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081ae2f-716e-457b-b245-a1146c1e8c55 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.232042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c948-ea93-424f-ad32-4ba80c8d36b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:15.232367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c948-ea93-424f-ad32-4ba80c8d36b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.233663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c948-ea93-424f-ad32-4ba80c8d36b4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-6081ae2f-716e-457b-b245-a1146c1e8c55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:15.243684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:15.244632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:15.245538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:15.245538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:15.245538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:15.245538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:15.245538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:15.245538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:15.245538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:15.245538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:15.245538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 314/631] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:15.248939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 318/632] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:15.250309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081ae2f-716e-457b-b245-a1146c1e8c55 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.250806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c58d2-e58c-477e-94f9-de6eb32d5187 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.251229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c58d2-e58c-477e-94f9-de6eb32d5187 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.251641 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c58d2-e58c-477e-94f9-de6eb32d5187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.271958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ff7c58d2-e58c-477e-94f9-de6eb32d5187 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:15.273147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ff7c58d2-e58c-477e-94f9-de6eb32d5187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:15.331601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.338604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.342877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 319/633] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:15.348662 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c58d2-e58c-477e-94f9-de6eb32d5187 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.355191 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081ae2f-716e-457b-b245-a1146c1e8c55 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.388530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219cc63-6b0b-4733-9ad9-9d54c8055fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.389186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219cc63-6b0b-4733-9ad9-9d54c8055fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.389486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219cc63-6b0b-4733-9ad9-9d54c8055fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.389762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219cc63-6b0b-4733-9ad9-9d54c8055fe6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.398302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219cc63-6b0b-4733-9ad9-9d54c8055fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.400140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219cc63-6b0b-4733-9ad9-9d54c8055fe6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-2219cc63-6b0b-4733-9ad9-9d54c8055fe6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:15.412122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:15.413290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 315/634] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:15.414322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219cc63-6b0b-4733-9ad9-9d54c8055fe6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.454935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c58d2-e58c-477e-94f9-de6eb32d5187 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.493507 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaed47b-dbee-444e-8bbc-2841734d5b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.494126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaed47b-dbee-444e-8bbc-2841734d5b2b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.494671 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaed47b-dbee-444e-8bbc-2841734d5b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.495010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaed47b-dbee-444e-8bbc-2841734d5b2b None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.495657 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaed47b-dbee-444e-8bbc-2841734d5b2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:15.495967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaed47b-dbee-444e-8bbc-2841734d5b2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.497417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaed47b-dbee-444e-8bbc-2841734d5b2b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.514512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 320/635] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:15.514512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c038f8a-8dc4-4a63-8679-fd4b2b4d883c None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.514512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c038f8a-8dc4-4a63-8679-fd4b2b4d883c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.514512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c038f8a-8dc4-4a63-8679-fd4b2b4d883c None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.514512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 321/636] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:15.514512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c038f8a-8dc4-4a63-8679-fd4b2b4d883c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.529315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219cc63-6b0b-4733-9ad9-9d54c8055fe6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.565942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d80294-ec3d-4684-b180-d118f62b9085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.566848 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d80294-ec3d-4684-b180-d118f62b9085 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.567342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d80294-ec3d-4684-b180-d118f62b9085 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.567623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d80294-ec3d-4684-b180-d118f62b9085 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.571158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.575317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d80294-ec3d-4684-b180-d118f62b9085 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.576749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d80294-ec3d-4684-b180-d118f62b9085 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-08d80294-ec3d-4684-b180-d118f62b9085 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:15.588715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:15.589677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 316/637] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:15.590700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d80294-ec3d-4684-b180-d118f62b9085 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.595633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.629792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c038f8a-8dc4-4a63-8679-fd4b2b4d883c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.663568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559d6a-e636-4bcd-afc9-8e6deb36da40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.664180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559d6a-e636-4bcd-afc9-8e6deb36da40 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.664465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559d6a-e636-4bcd-afc9-8e6deb36da40 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.664743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559d6a-e636-4bcd-afc9-8e6deb36da40 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.665460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11559d6a-e636-4bcd-afc9-8e6deb36da40 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:15.665774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11559d6a-e636-4bcd-afc9-8e6deb36da40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.667256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11559d6a-e636-4bcd-afc9-8e6deb36da40 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.685043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 322/638] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:15.686274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dacf65-0aaf-4b3c-86ed-ed7ab29a213c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.686561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dacf65-0aaf-4b3c-86ed-ed7ab29a213c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.686870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dacf65-0aaf-4b3c-86ed-ed7ab29a213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.696864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d80294-ec3d-4684-b180-d118f62b9085 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.704210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d4dacf65-0aaf-4b3c-86ed-ed7ab29a213c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:15.705405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d4dacf65-0aaf-4b3c-86ed-ed7ab29a213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:15.730475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90539-8e56-40b3-879b-4d61ec821d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.731078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90539-8e56-40b3-879b-4d61ec821d13 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.731364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90539-8e56-40b3-879b-4d61ec821d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.731637 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90539-8e56-40b3-879b-4d61ec821d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.732355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff90539-8e56-40b3-879b-4d61ec821d13 None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=9e2f71ebeca2441791a0241de737cad0) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:15.732664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff90539-8e56-40b3-879b-4d61ec821d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.734082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff90539-8e56-40b3-879b-4d61ec821d13 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.754222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 317/639] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/role_assignments?user.id=9e2f71ebeca2441791a0241de737cad0&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:15.754222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90539-8e56-40b3-879b-4d61ec821d13 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.776201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 323/640] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:15.777087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dacf65-0aaf-4b3c-86ed-ed7ab29a213c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.826371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.853687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.895210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90539-8e56-40b3-879b-4d61ec821d13 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.908521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dacf65-0aaf-4b3c-86ed-ed7ab29a213c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.936862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0817b-3f7e-4a90-8a47-c5580f280000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.937594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0817b-3f7e-4a90-8a47-c5580f280000 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.937879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0817b-3f7e-4a90-8a47-c5580f280000 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.938287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0817b-3f7e-4a90-8a47-c5580f280000 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.939018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0817b-3f7e-4a90-8a47-c5580f280000 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:15.939325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0817b-3f7e-4a90-8a47-c5580f280000 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.941010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0817b-3f7e-4a90-8a47-c5580f280000 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.947907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9afb1f-9292-441b-b8e6-75b4ae055cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.948548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9afb1f-9292-441b-b8e6-75b4ae055cbf None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.948889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9afb1f-9292-441b-b8e6-75b4ae055cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.949168 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9afb1f-9292-441b-b8e6-75b4ae055cbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.961492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9afb1f-9292-441b-b8e6-75b4ae055cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:15.962266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 318/641] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:15.963111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0817b-3f7e-4a90-8a47-c5580f280000 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-8f9afb1f-9292-441b-b8e6-75b4ae055cbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:15.966336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:15.967287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:15.968756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 324/642] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:15.969646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9afb1f-9292-441b-b8e6-75b4ae055cbf None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.091157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.093181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0817b-3f7e-4a90-8a47-c5580f280000 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.094645 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9afb1f-9292-441b-b8e6-75b4ae055cbf None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.121398 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.130739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9616d-0443-49ec-91c0-a3e80d4975e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.130913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60605a95-7573-42b1-829c-f90244509a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.131355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9616d-0443-49ec-91c0-a3e80d4975e1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.131458 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60605a95-7573-42b1-829c-f90244509a83 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.134557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9616d-0443-49ec-91c0-a3e80d4975e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.134676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60605a95-7573-42b1-829c-f90244509a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.134765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9616d-0443-49ec-91c0-a3e80d4975e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.134840 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60605a95-7573-42b1-829c-f90244509a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.142362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60605a95-7573-42b1-829c-f90244509a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.143812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60605a95-7573-42b1-829c-f90244509a83 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-60605a95-7573-42b1-829c-f90244509a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:16.159738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:16.161164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:16.162623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:16.162623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.162623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:16.162623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 319/643] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:16.162909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60605a95-7573-42b1-829c-f90244509a83 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.221428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9616d-0443-49ec-91c0-a3e80d4975e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.222985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9616d-0443-49ec-91c0-a3e80d4975e1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.277922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60605a95-7573-42b1-829c-f90244509a83 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.318238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b61db-6f71-457d-b01e-6e814c8f72ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.318681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b61db-6f71-457d-b01e-6e814c8f72ed None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.318955 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b61db-6f71-457d-b01e-6e814c8f72ed None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.319233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b61db-6f71-457d-b01e-6e814c8f72ed None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.319908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b61db-6f71-457d-b01e-6e814c8f72ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:16.320214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b61db-6f71-457d-b01e-6e814c8f72ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.321617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b61db-6f71-457d-b01e-6e814c8f72ed None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.324790 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.329443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 325/644] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:16.334094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 320/645] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:16.334094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b61db-6f71-457d-b01e-6e814c8f72ed None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.334435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9616d-0443-49ec-91c0-a3e80d4975e1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.379338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.438912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b61db-6f71-457d-b01e-6e814c8f72ed None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.439136 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9616d-0443-49ec-91c0-a3e80d4975e1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.473513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd39f24-6bb6-4449-859e-f120b1812f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.473904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4401bf-a2e6-44e9-89f4-a8a6be1b96ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.474123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd39f24-6bb6-4449-859e-f120b1812f91 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.474434 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd39f24-6bb6-4449-859e-f120b1812f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.474542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4401bf-a2e6-44e9-89f4-a8a6be1b96ba None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.474699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd39f24-6bb6-4449-859e-f120b1812f91 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.474814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4401bf-a2e6-44e9-89f4-a8a6be1b96ba None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.475058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4401bf-a2e6-44e9-89f4-a8a6be1b96ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.475337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd39f24-6bb6-4449-859e-f120b1812f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:16.475645 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd39f24-6bb6-4449-859e-f120b1812f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.477012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd39f24-6bb6-4449-859e-f120b1812f91 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.485507 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4401bf-a2e6-44e9-89f4-a8a6be1b96ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:16.493715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 321/646] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:16.493715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd39f24-6bb6-4449-859e-f120b1812f91 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-1e4401bf-a2e6-44e9-89f4-a8a6be1b96ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:16.493938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:16.494938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 326/647] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:16.495836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4401bf-a2e6-44e9-89f4-a8a6be1b96ba None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.561042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.607374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.608966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4401bf-a2e6-44e9-89f4-a8a6be1b96ba None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.610469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd39f24-6bb6-4449-859e-f120b1812f91 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.645725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4951b1-c9e9-4330-84bb-a3e59f9e4583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.646309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4951b1-c9e9-4330-84bb-a3e59f9e4583 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.646593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4951b1-c9e9-4330-84bb-a3e59f9e4583 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.646804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c04c8-79ce-4b34-a317-97eaafff9565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.646931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4951b1-c9e9-4330-84bb-a3e59f9e4583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.647436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c04c8-79ce-4b34-a317-97eaafff9565 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.647723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c04c8-79ce-4b34-a317-97eaafff9565 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.648001 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c04c8-79ce-4b34-a317-97eaafff9565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.659250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4951b1-c9e9-4330-84bb-a3e59f9e4583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.660770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c04c8-79ce-4b34-a317-97eaafff9565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.661392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4951b1-c9e9-4330-84bb-a3e59f9e4583 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.662494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c04c8-79ce-4b34-a317-97eaafff9565 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-0b4951b1-c9e9-4330-84bb-a3e59f9e4583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:16.676533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:16.677493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:16.678446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:16.678446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.678446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-db2c04c8-79ce-4b34-a317-97eaafff9565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:16.678622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:16.679505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:16.680405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:16.680405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.680405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:16.680586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 322/648] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:16.680586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4951b1-c9e9-4330-84bb-a3e59f9e4583 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.682795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 327/649] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:16.685034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c04c8-79ce-4b34-a317-97eaafff9565 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.789051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4951b1-c9e9-4330-84bb-a3e59f9e4583 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.791640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c04c8-79ce-4b34-a317-97eaafff9565 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.802423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.825793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbfc50-0ca8-4f5f-a604-53fc2b5aea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.826449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbfc50-0ca8-4f5f-a604-53fc2b5aea36 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.826736 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbfc50-0ca8-4f5f-a604-53fc2b5aea36 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.827096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbfc50-0ca8-4f5f-a604-53fc2b5aea36 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.827317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ef0f8-d64a-441b-b216-fb900b7d26b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.827768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbfc50-0ca8-4f5f-a604-53fc2b5aea36 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:16.828079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbfc50-0ca8-4f5f-a604-53fc2b5aea36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.828416 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef0f8-d64a-441b-b216-fb900b7d26b0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.828847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef0f8-d64a-441b-b216-fb900b7d26b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.829269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef0f8-d64a-441b-b216-fb900b7d26b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.829465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbfc50-0ca8-4f5f-a604-53fc2b5aea36 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.837545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ef0f8-d64a-441b-b216-fb900b7d26b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.839093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ef0f8-d64a-441b-b216-fb900b7d26b0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.840366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 328/650] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:16.841347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbfc50-0ca8-4f5f-a604-53fc2b5aea36 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-0d0ef0f8-d64a-441b-b216-fb900b7d26b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:16.855451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:16.856581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:16.857490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:16.857490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:16.857490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:16.857490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:16.857490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:16.857490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:16.857490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:16.857490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:16.857490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 323/651] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:16.857986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ef0f8-d64a-441b-b216-fb900b7d26b0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.877672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.956740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbfc50-0ca8-4f5f-a604-53fc2b5aea36 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.970002 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ef0f8-d64a-441b-b216-fb900b7d26b0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.993239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e17b73-2e16-4dad-9ee2-b7e249a6e374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.993855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17b73-2e16-4dad-9ee2-b7e249a6e374 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.994143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17b73-2e16-4dad-9ee2-b7e249a6e374 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.994452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17b73-2e16-4dad-9ee2-b7e249a6e374 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.995098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e17b73-2e16-4dad-9ee2-b7e249a6e374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:16.995414 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e17b73-2e16-4dad-9ee2-b7e249a6e374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.996796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e17b73-2e16-4dad-9ee2-b7e249a6e374 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.013062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 329/652] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.013062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e17b73-2e16-4dad-9ee2-b7e249a6e374 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.019071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca2ea-cab2-43f6-9a8b-46ae62ee3f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.019732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca2ea-cab2-43f6-9a8b-46ae62ee3f3c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.020013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca2ea-cab2-43f6-9a8b-46ae62ee3f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.020289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca2ea-cab2-43f6-9a8b-46ae62ee3f3c None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.020931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ca2ea-cab2-43f6-9a8b-46ae62ee3f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.021237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ca2ea-cab2-43f6-9a8b-46ae62ee3f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.022665 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ca2ea-cab2-43f6-9a8b-46ae62ee3f3c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.040200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 324/653] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.040200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca2ea-cab2-43f6-9a8b-46ae62ee3f3c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.049080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.110269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.126210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e17b73-2e16-4dad-9ee2-b7e249a6e374 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.141380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca2ea-cab2-43f6-9a8b-46ae62ee3f3c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.162776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d2c45-9c46-4e90-bb55-13ac3f289bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.163424 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d2c45-9c46-4e90-bb55-13ac3f289bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.163689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d2c45-9c46-4e90-bb55-13ac3f289bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.163968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d2c45-9c46-4e90-bb55-13ac3f289bd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.178097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d2c45-9c46-4e90-bb55-13ac3f289bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.179601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d2c45-9c46-4e90-bb55-13ac3f289bd8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.183954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f885a-1413-4ed4-b172-426a5eea86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.184567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f885a-1413-4ed4-b172-426a5eea86b0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.184847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f885a-1413-4ed4-b172-426a5eea86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.185119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f885a-1413-4ed4-b172-426a5eea86b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.185804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f885a-1413-4ed4-b172-426a5eea86b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.186111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f885a-1413-4ed4-b172-426a5eea86b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.187587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f885a-1413-4ed4-b172-426a5eea86b0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-a81d2c45-9c46-4e90-bb55-13ac3f289bd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:17.196196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:17.197183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:17.198128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:17.198128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:17.198128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:17.202021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 325/655] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.202136 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 330/655] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:17.202907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d2c45-9c46-4e90-bb55-13ac3f289bd8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.203008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f885a-1413-4ed4-b172-426a5eea86b0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.295427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.312588 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d2c45-9c46-4e90-bb55-13ac3f289bd8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.321349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f885a-1413-4ed4-b172-426a5eea86b0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.347357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1222-809d-42b1-804d-9ae872f991e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.348719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1222-809d-42b1-804d-9ae872f991e3 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.349030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1222-809d-42b1-804d-9ae872f991e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.349314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1222-809d-42b1-804d-9ae872f991e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.356079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee1222-809d-42b1-804d-9ae872f991e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.357380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.357613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee1222-809d-42b1-804d-9ae872f991e3 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.362409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fadfcd-08a2-48be-864a-8f8180b022ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.363074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fadfcd-08a2-48be-864a-8f8180b022ee None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.363881 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fadfcd-08a2-48be-864a-8f8180b022ee None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.364141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fadfcd-08a2-48be-864a-8f8180b022ee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-93ee1222-809d-42b1-804d-9ae872f991e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:17.370252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:17.371411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:17.372367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:17.372367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:17.372367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:17.372367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:17.372367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:17.372367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:17.372367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:17.372367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:17.372367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 331/656] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:17.372367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1222-809d-42b1-804d-9ae872f991e3 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.377030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fadfcd-08a2-48be-864a-8f8180b022ee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.378795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fadfcd-08a2-48be-864a-8f8180b022ee None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-51fadfcd-08a2-48be-864a-8f8180b022ee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:17.390543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:17.391690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:17.392929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:17.392929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:17.392929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:17.392929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:17.392929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:17.392929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:17.392929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:17.392929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:17.392929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:17.392929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:17.396221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 326/657] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:17.397045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fadfcd-08a2-48be-864a-8f8180b022ee None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.484765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1222-809d-42b1-804d-9ae872f991e3 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.512833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fadfcd-08a2-48be-864a-8f8180b022ee None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.521801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac003e0f-c676-494a-9ce8-486ab71348cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.522456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003e0f-c676-494a-9ce8-486ab71348cf None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.522741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003e0f-c676-494a-9ce8-486ab71348cf None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.523019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003e0f-c676-494a-9ce8-486ab71348cf None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.523704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac003e0f-c676-494a-9ce8-486ab71348cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.524054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac003e0f-c676-494a-9ce8-486ab71348cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.525448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac003e0f-c676-494a-9ce8-486ab71348cf None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.542413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 332/658] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.542413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac003e0f-c676-494a-9ce8-486ab71348cf None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.544614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.556204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f097-01ee-41ef-82eb-c07e0c293173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.556874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f097-01ee-41ef-82eb-c07e0c293173 None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.557154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f097-01ee-41ef-82eb-c07e0c293173 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.557427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f097-01ee-41ef-82eb-c07e0c293173 None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/656ce4b09cf6425193b7e58562ccaced/roles/0cef1088535b4535b2d6d5cc17c09549` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.574605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3f097-01ee-41ef-82eb-c07e0c293173 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=656ce4b09cf6425193b7e58562ccaced, role_id=0cef1088535b4535b2d6d5cc17c09549)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.578261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3f097-01ee-41ef-82eb-c07e0c293173 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.642844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac003e0f-c676-494a-9ce8-486ab71348cf None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.664743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 327/659] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:17 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/656ce4b09cf6425193b7e58562ccaced/roles/0cef1088535b4535b2d6d5cc17c09549 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:17.665994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f097-01ee-41ef-82eb-c07e0c293173 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.692201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f9822-12dc-4681-8ed6-7d4d9c4e4943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.692868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9822-12dc-4681-8ed6-7d4d9c4e4943 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.693162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9822-12dc-4681-8ed6-7d4d9c4e4943 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.693450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9822-12dc-4681-8ed6-7d4d9c4e4943 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.694163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f9822-12dc-4681-8ed6-7d4d9c4e4943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.694544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f9822-12dc-4681-8ed6-7d4d9c4e4943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.696321 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f9822-12dc-4681-8ed6-7d4d9c4e4943 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.716208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 333/660] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.716208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f9822-12dc-4681-8ed6-7d4d9c4e4943 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.730896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.802378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.804861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f097-01ee-41ef-82eb-c07e0c293173 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.848057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec577d14-144d-41c1-b46e-27a5da1adcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.848691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec577d14-144d-41c1-b46e-27a5da1adcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.849039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec577d14-144d-41c1-b46e-27a5da1adcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.849318 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec577d14-144d-41c1-b46e-27a5da1adcb2 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.850055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec577d14-144d-41c1-b46e-27a5da1adcb2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.850387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec577d14-144d-41c1-b46e-27a5da1adcb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.850743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f9822-12dc-4681-8ed6-7d4d9c4e4943 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.851823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec577d14-144d-41c1-b46e-27a5da1adcb2 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.871831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 328/661] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.873053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec577d14-144d-41c1-b46e-27a5da1adcb2 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.888354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c50502-2acb-4dbc-955e-4a25c802aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.888995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c50502-2acb-4dbc-955e-4a25c802aa13 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.889276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c50502-2acb-4dbc-955e-4a25c802aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.889555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c50502-2acb-4dbc-955e-4a25c802aa13 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.898293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c50502-2acb-4dbc-955e-4a25c802aa13 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.899760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c50502-2acb-4dbc-955e-4a25c802aa13 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-e6c50502-2acb-4dbc-955e-4a25c802aa13 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:17.910982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:17.912167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:17.913124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 334/662] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:17.913730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899ddd-62bd-4fa6-b1e8-44009b0d3247 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.913730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899ddd-62bd-4fa6-b1e8-44009b0d3247 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.913869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899ddd-62bd-4fa6-b1e8-44009b0d3247 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.915260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 335/663] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:17.915965 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899ddd-62bd-4fa6-b1e8-44009b0d3247 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.981768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.985116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec577d14-144d-41c1-b46e-27a5da1adcb2 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.022117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633cf81-39ad-4473-8e63-a2c2216c5150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.022757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633cf81-39ad-4473-8e63-a2c2216c5150 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.023034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633cf81-39ad-4473-8e63-a2c2216c5150 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.023300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633cf81-39ad-4473-8e63-a2c2216c5150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.024015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633cf81-39ad-4473-8e63-a2c2216c5150 None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=a3e56c9d900f4e4e91ea944d4cb0a40a) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:18.024321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633cf81-39ad-4473-8e63-a2c2216c5150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.025736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633cf81-39ad-4473-8e63-a2c2216c5150 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.031766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 329/664] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/role_assignments?user.id=a3e56c9d900f4e4e91ea944d4cb0a40a&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:18.032545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633cf81-39ad-4473-8e63-a2c2216c5150 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.043207 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899ddd-62bd-4fa6-b1e8-44009b0d3247 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.079994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.096231 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ed45c-3b2b-46a6-b2ea-45f6d2dc4815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.098960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ed45c-3b2b-46a6-b2ea-45f6d2dc4815 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.099515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ed45c-3b2b-46a6-b2ea-45f6d2dc4815 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.100204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ed45c-3b2b-46a6-b2ea-45f6d2dc4815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.157222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633cf81-39ad-4473-8e63-a2c2216c5150 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.203250 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ed45c-3b2b-46a6-b2ea-45f6d2dc4815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.204732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ed45c-3b2b-46a6-b2ea-45f6d2dc4815 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.219266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d27486-7933-47cd-9a04-b42adc867f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.220460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27486-7933-47cd-9a04-b42adc867f6c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.221335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27486-7933-47cd-9a04-b42adc867f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.221831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27486-7933-47cd-9a04-b42adc867f6c None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.223074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d27486-7933-47cd-9a04-b42adc867f6c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:18.223561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d27486-7933-47cd-9a04-b42adc867f6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.225266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d27486-7933-47cd-9a04-b42adc867f6c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.246333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 330/665] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:18.247680 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1b53d-28a7-42f9-b6a3-1ab129eb31db None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.247967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1b53d-28a7-42f9-b6a3-1ab129eb31db None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.248238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1b53d-28a7-42f9-b6a3-1ab129eb31db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.270812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-19a1b53d-28a7-42f9-b6a3-1ab129eb31db None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:18.272000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-19a1b53d-28a7-42f9-b6a3-1ab129eb31db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:18.290560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.334225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 336/666] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:18.335325 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ed45c-3b2b-46a6-b2ea-45f6d2dc4815 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.366891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.369844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 331/667] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:18.371459 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1b53d-28a7-42f9-b6a3-1ab129eb31db None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.448593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ed45c-3b2b-46a6-b2ea-45f6d2dc4815 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.487393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df2a90-4e57-4fc7-9c6d-e5fe29981ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.488308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df2a90-4e57-4fc7-9c6d-e5fe29981ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.488904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df2a90-4e57-4fc7-9c6d-e5fe29981ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.489511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df2a90-4e57-4fc7-9c6d-e5fe29981ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.507821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1b53d-28a7-42f9-b6a3-1ab129eb31db None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.545913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f7eb1-4c3a-4b6b-ac59-8eab25753b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.546847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f7eb1-4c3a-4b6b-ac59-8eab25753b50 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.547229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f7eb1-4c3a-4b6b-ac59-8eab25753b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.547604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f7eb1-4c3a-4b6b-ac59-8eab25753b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.558582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f7eb1-4c3a-4b6b-ac59-8eab25753b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.560360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f7eb1-4c3a-4b6b-ac59-8eab25753b50 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-b22f7eb1-4c3a-4b6b-ac59-8eab25753b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:18.576349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:18.577564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:18.578727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:18.578727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:18.578727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:18.578937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df2a90-4e57-4fc7-9c6d-e5fe29981ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.580104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df2a90-4e57-4fc7-9c6d-e5fe29981ce9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.580230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 332/668] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:18.588980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f7eb1-4c3a-4b6b-ac59-8eab25753b50 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.592706 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.631601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.739688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f7eb1-4c3a-4b6b-ac59-8eab25753b50 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.753413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 337/669] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:18.755188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df2a90-4e57-4fc7-9c6d-e5fe29981ce9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.780084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f10809-5090-4784-9cf2-b0b7a4b831fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.780643 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f10809-5090-4784-9cf2-b0b7a4b831fd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.780928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f10809-5090-4784-9cf2-b0b7a4b831fd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.781205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f10809-5090-4784-9cf2-b0b7a4b831fd None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.781860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f10809-5090-4784-9cf2-b0b7a4b831fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:18.782168 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f10809-5090-4784-9cf2-b0b7a4b831fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.783807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f10809-5090-4784-9cf2-b0b7a4b831fd None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.798694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 333/670] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:18.799621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f10809-5090-4784-9cf2-b0b7a4b831fd None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.867903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df2a90-4e57-4fc7-9c6d-e5fe29981ce9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.869509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.896377 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.911468 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e873c1d-57fc-4b2c-93e1-617e49668251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.912177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873c1d-57fc-4b2c-93e1-617e49668251 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.912465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873c1d-57fc-4b2c-93e1-617e49668251 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.912748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873c1d-57fc-4b2c-93e1-617e49668251 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.915485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f10809-5090-4784-9cf2-b0b7a4b831fd None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.926246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e873c1d-57fc-4b2c-93e1-617e49668251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3e873c1d-57fc-4b2c-93e1-617e49668251 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:18.929430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:18.930408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:18.931659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 338/671] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:18.932438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e873c1d-57fc-4b2c-93e1-617e49668251 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.960981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30568fc6-659b-4bd8-ae62-7edcc28b310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.961997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30568fc6-659b-4bd8-ae62-7edcc28b310f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.962546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30568fc6-659b-4bd8-ae62-7edcc28b310f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.963037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30568fc6-659b-4bd8-ae62-7edcc28b310f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.974186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30568fc6-659b-4bd8-ae62-7edcc28b310f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.975928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30568fc6-659b-4bd8-ae62-7edcc28b310f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-30568fc6-659b-4bd8-ae62-7edcc28b310f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:18.991820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:18.992801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:18.993816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:18.993816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:18.993816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:18.995925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 334/672] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:18.997008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30568fc6-659b-4bd8-ae62-7edcc28b310f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.052026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e873c1d-57fc-4b2c-93e1-617e49668251 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.091554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8693c-bfe3-4c70-bc42-161cfcf03d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.092517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8693c-bfe3-4c70-bc42-161cfcf03d33 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.093005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8693c-bfe3-4c70-bc42-161cfcf03d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.093479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8693c-bfe3-4c70-bc42-161cfcf03d33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.100642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8693c-bfe3-4c70-bc42-161cfcf03d33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.102376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8693c-bfe3-4c70-bc42-161cfcf03d33 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-bfd8693c-bfe3-4c70-bc42-161cfcf03d33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:19.114317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:19.115227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:19.116127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:19.116127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:19.116127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:19.116127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:19.116127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:19.116127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:19.116127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:19.116127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:19.118465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 339/673] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:19.119518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8693c-bfe3-4c70-bc42-161cfcf03d33 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.137024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30568fc6-659b-4bd8-ae62-7edcc28b310f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.159864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.173766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.193827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d646b2b-ff84-4f79-8985-3c1a139121cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.194473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646b2b-ff84-4f79-8985-3c1a139121cd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.194827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646b2b-ff84-4f79-8985-3c1a139121cd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.195105 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646b2b-ff84-4f79-8985-3c1a139121cd None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.195810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d646b2b-ff84-4f79-8985-3c1a139121cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.196071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d646b2b-ff84-4f79-8985-3c1a139121cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.197480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d646b2b-ff84-4f79-8985-3c1a139121cd None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.210328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 335/674] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.211208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d646b2b-ff84-4f79-8985-3c1a139121cd None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.248348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8693c-bfe3-4c70-bc42-161cfcf03d33 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.286915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77ef1b-1310-4bcf-be10-532459490337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.287914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77ef1b-1310-4bcf-be10-532459490337 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.288402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77ef1b-1310-4bcf-be10-532459490337 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.288907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77ef1b-1310-4bcf-be10-532459490337 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.289750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77ef1b-1310-4bcf-be10-532459490337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.290298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77ef1b-1310-4bcf-be10-532459490337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.292146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77ef1b-1310-4bcf-be10-532459490337 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.309893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 340/675] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.311176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77ef1b-1310-4bcf-be10-532459490337 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.318648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d646b2b-ff84-4f79-8985-3c1a139121cd None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.354048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb89c8-386c-406d-8fb4-e99dcf678a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.354750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb89c8-386c-406d-8fb4-e99dcf678a35 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.355029 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb89c8-386c-406d-8fb4-e99dcf678a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.355299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb89c8-386c-406d-8fb4-e99dcf678a35 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.356035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb89c8-386c-406d-8fb4-e99dcf678a35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.356342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb89c8-386c-406d-8fb4-e99dcf678a35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.357912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb89c8-386c-406d-8fb4-e99dcf678a35 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.370846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 336/676] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.371753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb89c8-386c-406d-8fb4-e99dcf678a35 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.413907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.426908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77ef1b-1310-4bcf-be10-532459490337 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.429745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.468013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fba4f0-3442-427c-b077-b8f9c7c3b3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.469117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fba4f0-3442-427c-b077-b8f9c7c3b3be None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.469701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fba4f0-3442-427c-b077-b8f9c7c3b3be None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.470178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fba4f0-3442-427c-b077-b8f9c7c3b3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.479076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb89c8-386c-406d-8fb4-e99dcf678a35 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.483994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fba4f0-3442-427c-b077-b8f9c7c3b3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.485736 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fba4f0-3442-427c-b077-b8f9c7c3b3be None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-74fba4f0-3442-427c-b077-b8f9c7c3b3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:19.502727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:19.508531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:19.509428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:19.509428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:19.509428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:19.509428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 341/677] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:19.509428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fba4f0-3442-427c-b077-b8f9c7c3b3be None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.519694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc755a56-dd37-4a9e-85b3-719728328177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.520480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc755a56-dd37-4a9e-85b3-719728328177 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.520761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc755a56-dd37-4a9e-85b3-719728328177 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.521035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc755a56-dd37-4a9e-85b3-719728328177 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.528223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc755a56-dd37-4a9e-85b3-719728328177 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.529715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc755a56-dd37-4a9e-85b3-719728328177 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-fc755a56-dd37-4a9e-85b3-719728328177 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:19.541994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:19.542999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:19.543918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:19.543918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:19.543918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:19.543918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:19.543918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:19.543918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:19.543918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:19.543918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:19.544367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 337/678] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:19.545095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc755a56-dd37-4a9e-85b3-719728328177 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.629984 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fba4f0-3442-427c-b077-b8f9c7c3b3be None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.649169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.652706 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc755a56-dd37-4a9e-85b3-719728328177 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.674300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ec90-9197-4714-a9e1-799af216019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.674300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ec90-9197-4714-a9e1-799af216019c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.674300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ec90-9197-4714-a9e1-799af216019c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.674300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ec90-9197-4714-a9e1-799af216019c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.674689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468ec90-9197-4714-a9e1-799af216019c None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=948a5df1d4244c839a7faeb54f93dfbb) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.674689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468ec90-9197-4714-a9e1-799af216019c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.674689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468ec90-9197-4714-a9e1-799af216019c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.679889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 342/679] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/role_assignments?user.id=948a5df1d4244c839a7faeb54f93dfbb&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.680839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ec90-9197-4714-a9e1-799af216019c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.688672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed25549-d5e9-4865-a86b-589080dc9e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.689360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed25549-d5e9-4865-a86b-589080dc9e0a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.689639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed25549-d5e9-4865-a86b-589080dc9e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.689910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed25549-d5e9-4865-a86b-589080dc9e0a None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.690881 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed25549-d5e9-4865-a86b-589080dc9e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.691758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed25549-d5e9-4865-a86b-589080dc9e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.693133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed25549-d5e9-4865-a86b-589080dc9e0a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.708413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 338/680] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.710137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.713804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed25549-d5e9-4865-a86b-589080dc9e0a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.803065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ec90-9197-4714-a9e1-799af216019c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.821801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed25549-d5e9-4865-a86b-589080dc9e0a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.843073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc235e82-6fa3-472b-8dbe-4bb34fb4a16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.843958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235e82-6fa3-472b-8dbe-4bb34fb4a16d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.844424 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235e82-6fa3-472b-8dbe-4bb34fb4a16d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.844860 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235e82-6fa3-472b-8dbe-4bb34fb4a16d None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.845846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc235e82-6fa3-472b-8dbe-4bb34fb4a16d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.846346 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc235e82-6fa3-472b-8dbe-4bb34fb4a16d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.848165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc235e82-6fa3-472b-8dbe-4bb34fb4a16d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.860832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9812f-0986-4d21-8475-aa4964fef1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.861598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9812f-0986-4d21-8475-aa4964fef1cd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.861973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9812f-0986-4d21-8475-aa4964fef1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.862449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9812f-0986-4d21-8475-aa4964fef1cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.864021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 343/681] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.876518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9812f-0986-4d21-8475-aa4964fef1cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.878120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9812f-0986-4d21-8475-aa4964fef1cd None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.881906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc235e82-6fa3-472b-8dbe-4bb34fb4a16d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-2dc9812f-0986-4d21-8475-aa4964fef1cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:19.892189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:19.893256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:19.894774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:19.894774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:19.894774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:19.894774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:19.894774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:19.894774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:19.894774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:19.894774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:19.894774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:19.894774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:19.898316 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 339/682] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:19.899789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021aa7f-85a2-4ea7-8fa5-aea15b5bde8e None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.900071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021aa7f-85a2-4ea7-8fa5-aea15b5bde8e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.900345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021aa7f-85a2-4ea7-8fa5-aea15b5bde8e None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.902903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 340/683] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:19.904830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021aa7f-85a2-4ea7-8fa5-aea15b5bde8e None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.926323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.993977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.020613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc235e82-6fa3-472b-8dbe-4bb34fb4a16d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.027981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021aa7f-85a2-4ea7-8fa5-aea15b5bde8e None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.067845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19a4ab-559b-4def-a23c-2f93e9fa4108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.068461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19a4ab-559b-4def-a23c-2f93e9fa4108 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.068740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19a4ab-559b-4def-a23c-2f93e9fa4108 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.068877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d1247-9d8e-44d6-9a5c-0fb9c473349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.068993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19a4ab-559b-4def-a23c-2f93e9fa4108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.069732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19a4ab-559b-4def-a23c-2f93e9fa4108 None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=80696f8fcd8e4d01b303bdfd81a6dc9f) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:20.069906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d1247-9d8e-44d6-9a5c-0fb9c473349d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.070025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19a4ab-559b-4def-a23c-2f93e9fa4108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:20.070481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d1247-9d8e-44d6-9a5c-0fb9c473349d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.070898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d1247-9d8e-44d6-9a5c-0fb9c473349d None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.071518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19a4ab-559b-4def-a23c-2f93e9fa4108 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:20.071939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d1247-9d8e-44d6-9a5c-0fb9c473349d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:20.072388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d1247-9d8e-44d6-9a5c-0fb9c473349d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:20.074074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d1247-9d8e-44d6-9a5c-0fb9c473349d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:20.082285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 344/684] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/role_assignments?user.id=80696f8fcd8e4d01b303bdfd81a6dc9f&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:20.084060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834aa5-00be-47a5-8728-6ee9716620b9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.084547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834aa5-00be-47a5-8728-6ee9716620b9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.085036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834aa5-00be-47a5-8728-6ee9716620b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.109594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 341/685] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:20.116784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d1247-9d8e-44d6-9a5c-0fb9c473349d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.127538 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0f834aa5-00be-47a5-8728-6ee9716620b9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:20.131856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0f834aa5-00be-47a5-8728-6ee9716620b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:20.268269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 345/686] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:20.270756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.310040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d1247-9d8e-44d6-9a5c-0fb9c473349d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.346750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bcc99-197c-4d64-9f0a-99ec9946c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.348100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bcc99-197c-4d64-9f0a-99ec9946c37b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.348666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bcc99-197c-4d64-9f0a-99ec9946c37b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.349074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bcc99-197c-4d64-9f0a-99ec9946c37b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.352266 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9453d2-dbc9-448d-9fa8-d8f00e33a4aa None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.352777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9453d2-dbc9-448d-9fa8-d8f00e33a4aa None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.353231 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9453d2-dbc9-448d-9fa8-d8f00e33a4aa None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.355941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 346/687] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:20.360090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193456d-272e-4f5e-84cb-e0641b73724f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.360360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193456d-272e-4f5e-84cb-e0641b73724f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.360637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193456d-272e-4f5e-84cb-e0641b73724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.379517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e193456d-272e-4f5e-84cb-e0641b73724f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:20.380496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e193456d-272e-4f5e-84cb-e0641b73724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:20.437486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bcc99-197c-4d64-9f0a-99ec9946c37b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:20.440033 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bcc99-197c-4d64-9f0a-99ec9946c37b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:20.466304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 347/688] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:20.530733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.558538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 342/689] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:27:20.563960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193456d-272e-4f5e-84cb-e0641b73724f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.573013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.587932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bcc99-197c-4d64-9f0a-99ec9946c37b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.742029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193456d-272e-4f5e-84cb-e0641b73724f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.770509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bcc99-197c-4d64-9f0a-99ec9946c37b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.781750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb63808-9d87-4f27-9d86-453088edc765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.782464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb63808-9d87-4f27-9d86-453088edc765 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.782746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb63808-9d87-4f27-9d86-453088edc765 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.783019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb63808-9d87-4f27-9d86-453088edc765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.794662 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb63808-9d87-4f27-9d86-453088edc765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:20.796543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb63808-9d87-4f27-9d86-453088edc765 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-4eb63808-9d87-4f27-9d86-453088edc765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:20.819617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:20.820636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:20.821539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:20.821539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:20.821539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:20.825391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 348/690] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:20.826843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb63808-9d87-4f27-9d86-453088edc765 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.833851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d731af-8b57-4fa2-a319-9362d745002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.834795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d731af-8b57-4fa2-a319-9362d745002e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.835299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d731af-8b57-4fa2-a319-9362d745002e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.835793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d731af-8b57-4fa2-a319-9362d745002e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.850829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d731af-8b57-4fa2-a319-9362d745002e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-c6d731af-8b57-4fa2-a319-9362d745002e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:20.859522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:20.860475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:20.861332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:20.863804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 343/691] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:20.864678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d731af-8b57-4fa2-a319-9362d745002e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.899711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.917325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.961709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb63808-9d87-4f27-9d86-453088edc765 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.987257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d731af-8b57-4fa2-a319-9362d745002e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.000660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be812ce0-ee6a-4bc8-9097-6c9b16959c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.001544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be812ce0-ee6a-4bc8-9097-6c9b16959c7f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.001971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be812ce0-ee6a-4bc8-9097-6c9b16959c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.002411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be812ce0-ee6a-4bc8-9097-6c9b16959c7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.014065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be812ce0-ee6a-4bc8-9097-6c9b16959c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.015716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be812ce0-ee6a-4bc8-9097-6c9b16959c7f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.024158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f95c8-3c9a-40cc-ba68-7c32ea4e815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.024772 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f95c8-3c9a-40cc-ba68-7c32ea4e815a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.025053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f95c8-3c9a-40cc-ba68-7c32ea4e815a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.025333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f95c8-3c9a-40cc-ba68-7c32ea4e815a None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.026119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f95c8-3c9a-40cc-ba68-7c32ea4e815a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.026319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f95c8-3c9a-40cc-ba68-7c32ea4e815a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.027713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f95c8-3c9a-40cc-ba68-7c32ea4e815a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-be812ce0-ee6a-4bc8-9097-6c9b16959c7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:21.032900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:21.034044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:21.035585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:21.035585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:21.035585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:21.042533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 349/693] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:21.043267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be812ce0-ee6a-4bc8-9097-6c9b16959c7f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.043705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 344/693] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:21.044538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f95c8-3c9a-40cc-ba68-7c32ea4e815a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.146222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.151921 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f95c8-3c9a-40cc-ba68-7c32ea4e815a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.159723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be812ce0-ee6a-4bc8-9097-6c9b16959c7f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.169629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.198809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eca13-877e-4b6a-ad1b-88ac854d04de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.199416 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eca13-877e-4b6a-ad1b-88ac854d04de None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.199711 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eca13-877e-4b6a-ad1b-88ac854d04de None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.199963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eca13-877e-4b6a-ad1b-88ac854d04de None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.200599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eca13-877e-4b6a-ad1b-88ac854d04de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.200902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eca13-877e-4b6a-ad1b-88ac854d04de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.202357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eca13-877e-4b6a-ad1b-88ac854d04de None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.211979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13325d-2169-465d-ae9d-2ecb6c12197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.212873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13325d-2169-465d-ae9d-2ecb6c12197a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.213358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13325d-2169-465d-ae9d-2ecb6c12197a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.213837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13325d-2169-465d-ae9d-2ecb6c12197a None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.219071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13325d-2169-465d-ae9d-2ecb6c12197a None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.219209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 345/694] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:21.219209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eca13-877e-4b6a-ad1b-88ac854d04de None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.219363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13325d-2169-465d-ae9d-2ecb6c12197a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.219976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13325d-2169-465d-ae9d-2ecb6c12197a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.234284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 350/695] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:21.235435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13325d-2169-465d-ae9d-2ecb6c12197a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.331365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eca13-877e-4b6a-ad1b-88ac854d04de None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.352327 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13325d-2169-465d-ae9d-2ecb6c12197a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.369170 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856ca8a-2121-4757-8cbb-cef4afb1fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.369908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856ca8a-2121-4757-8cbb-cef4afb1fe81 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.370280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856ca8a-2121-4757-8cbb-cef4afb1fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.370625 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856ca8a-2121-4757-8cbb-cef4afb1fe81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.377741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856ca8a-2121-4757-8cbb-cef4afb1fe81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.380247 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856ca8a-2121-4757-8cbb-cef4afb1fe81 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.390796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceae57-d9d9-4a29-8d07-3e80a16441ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.391842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceae57-d9d9-4a29-8d07-3e80a16441ce None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.392310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceae57-d9d9-4a29-8d07-3e80a16441ce None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.392776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceae57-d9d9-4a29-8d07-3e80a16441ce None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-1856ca8a-2121-4757-8cbb-cef4afb1fe81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:21.393134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:21.394016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:21.395515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:21.395515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:21.395515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:21.395515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:21.395515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:21.395515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:21.395515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:21.395515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:21.395978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ceae57-d9d9-4a29-8d07-3e80a16441ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.397020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ceae57-d9d9-4a29-8d07-3e80a16441ce None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.397198 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 346/696] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:21.397975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856ca8a-2121-4757-8cbb-cef4afb1fe81 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.422972 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.495094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 351/697] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:27:21 2022] POST /identity/v3/users => generated 254 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:21.496563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceae57-d9d9-4a29-8d07-3e80a16441ce None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.514271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856ca8a-2121-4757-8cbb-cef4afb1fe81 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.551401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.559564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15749420-5377-4386-9daf-f984ddc88a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.560217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15749420-5377-4386-9daf-f984ddc88a40 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.560550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15749420-5377-4386-9daf-f984ddc88a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.560830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15749420-5377-4386-9daf-f984ddc88a40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.575040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15749420-5377-4386-9daf-f984ddc88a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.576552 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15749420-5377-4386-9daf-f984ddc88a40 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-15749420-5377-4386-9daf-f984ddc88a40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:21.596212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:21.597222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:21.598705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:21.598705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:21.598705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:21.598705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 347/698] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:21.604506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15749420-5377-4386-9daf-f984ddc88a40 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.703015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.728834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceae57-d9d9-4a29-8d07-3e80a16441ce None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.741127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15749420-5377-4386-9daf-f984ddc88a40 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.777267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb37ec-e2d5-47d4-b2b8-0f5740e76713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.777891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb37ec-e2d5-47d4-b2b8-0f5740e76713 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.778612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb37ec-e2d5-47d4-b2b8-0f5740e76713 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.778891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb37ec-e2d5-47d4-b2b8-0f5740e76713 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.779597 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb37ec-e2d5-47d4-b2b8-0f5740e76713 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.780183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb37ec-e2d5-47d4-b2b8-0f5740e76713 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.781939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb37ec-e2d5-47d4-b2b8-0f5740e76713 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.789520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6648fd5-0b8e-4df4-a6e6-3ec59a02be6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.790296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6648fd5-0b8e-4df4-a6e6-3ec59a02be6a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.791154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6648fd5-0b8e-4df4-a6e6-3ec59a02be6a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.791530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6648fd5-0b8e-4df4-a6e6-3ec59a02be6a None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.792347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6648fd5-0b8e-4df4-a6e6-3ec59a02be6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.792748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6648fd5-0b8e-4df4-a6e6-3ec59a02be6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.795011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6648fd5-0b8e-4df4-a6e6-3ec59a02be6a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.796699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 352/699] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:21.802695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb37ec-e2d5-47d4-b2b8-0f5740e76713 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.813476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 348/700] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:21.820220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6648fd5-0b8e-4df4-a6e6-3ec59a02be6a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.921739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.938741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb37ec-e2d5-47d4-b2b8-0f5740e76713 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.943214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6648fd5-0b8e-4df4-a6e6-3ec59a02be6a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.978701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.983731 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225a652-0fe1-44b2-bcc5-c0112fe4ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.984626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225a652-0fe1-44b2-bcc5-c0112fe4ca23 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.985076 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225a652-0fe1-44b2-bcc5-c0112fe4ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.989328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225a652-0fe1-44b2-bcc5-c0112fe4ca23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.989328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225a652-0fe1-44b2-bcc5-c0112fe4ca23 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=9e2f71ebeca2441791a0241de737cad0) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.989328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225a652-0fe1-44b2-bcc5-c0112fe4ca23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.989583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96a90-cecf-4b5f-a46a-505df9e3b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.989583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96a90-cecf-4b5f-a46a-505df9e3b979 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.989583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96a90-cecf-4b5f-a46a-505df9e3b979 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.989801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225a652-0fe1-44b2-bcc5-c0112fe4ca23 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.989874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96a90-cecf-4b5f-a46a-505df9e3b979 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.995990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 353/701] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/role_assignments?user.id=9e2f71ebeca2441791a0241de737cad0&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:21.997608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d284-2c56-4d5b-9ae2-56144d03e854 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.998133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d284-2c56-4d5b-9ae2-56144d03e854 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.998656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d284-2c56-4d5b-9ae2-56144d03e854 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.000366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 354/702] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:22.006277 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f96a90-cecf-4b5f-a46a-505df9e3b979 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:22.008167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41793a5-3c62-4aff-ba36-b4077f54b0cd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.008455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41793a5-3c62-4aff-ba36-b4077f54b0cd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.008729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41793a5-3c62-4aff-ba36-b4077f54b0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.008985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f96a90-cecf-4b5f-a46a-505df9e3b979 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-90f96a90-cecf-4b5f-a46a-505df9e3b979 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:22.023137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:22.024308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:22.025286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:22.025286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:22.025286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:22.025286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:22.025286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:22.025286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:22.025286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:22.025286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:22.025286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:22.025286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:22.028024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 349/703] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:22.034126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96a90-cecf-4b5f-a46a-505df9e3b979 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.050184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f41793a5-3c62-4aff-ba36-b4077f54b0cd None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:22.052397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f41793a5-3c62-4aff-ba36-b4077f54b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:22.157294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96a90-cecf-4b5f-a46a-505df9e3b979 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:22.200899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 355/704] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:22.209334 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bd79f-5ca0-413b-93a0-dcb17badf6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:22.210335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bd79f-5ca0-413b-93a0-dcb17badf6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.210822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bd79f-5ca0-413b-93a0-dcb17badf6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.211337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bd79f-5ca0-413b-93a0-dcb17badf6a3 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.212292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bd79f-5ca0-413b-93a0-dcb17badf6a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:22.212807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bd79f-5ca0-413b-93a0-dcb17badf6a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:22.214492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bd79f-5ca0-413b-93a0-dcb17badf6a3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:22.234349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 350/705] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:22.242245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41793a5-3c62-4aff-ba36-b4077f54b0cd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.360800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:22.401651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41793a5-3c62-4aff-ba36-b4077f54b0cd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:22.450610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cc4cb-d1c5-4a58-b013-500ec7f5ba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:22.451143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cc4cb-d1c5-4a58-b013-500ec7f5ba0b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.451423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cc4cb-d1c5-4a58-b013-500ec7f5ba0b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.451697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cc4cb-d1c5-4a58-b013-500ec7f5ba0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.459729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72dda-2b0d-455c-9aad-015bf548867e None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.460026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72dda-2b0d-455c-9aad-015bf548867e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.460278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72dda-2b0d-455c-9aad-015bf548867e None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.461742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 351/706] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:22.467122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70470a2b-24a3-4353-8359-78a70217fcab None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.467406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70470a2b-24a3-4353-8359-78a70217fcab None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.467732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70470a2b-24a3-4353-8359-78a70217fcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.509023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-70470a2b-24a3-4353-8359-78a70217fcab None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:22.510239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-70470a2b-24a3-4353-8359-78a70217fcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:22.524747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cc4cb-d1c5-4a58-b013-500ec7f5ba0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:22.526084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cc4cb-d1c5-4a58-b013-500ec7f5ba0b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:22.588260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:22.613528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:22.615585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 352/707] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:22.616942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70470a2b-24a3-4353-8359-78a70217fcab None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.664689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 356/708] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:22.670551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cc4cb-d1c5-4a58-b013-500ec7f5ba0b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.800697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70470a2b-24a3-4353-8359-78a70217fcab None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:22.837809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cc4cb-d1c5-4a58-b013-500ec7f5ba0b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:22.866635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff27db9-860a-4904-8697-fafe53da6b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:22.867269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff27db9-860a-4904-8697-fafe53da6b5e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.867544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff27db9-860a-4904-8697-fafe53da6b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.867810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff27db9-860a-4904-8697-fafe53da6b5e None admin] PATH_INFO: `/v3/services/network` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.868455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff27db9-860a-4904-8697-fafe53da6b5e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:22.869804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff27db9-860a-4904-8697-fafe53da6b5e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:22.875251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c086fbe-bdb3-4b17-b892-e226f3b32e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:22.875893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c086fbe-bdb3-4b17-b892-e226f3b32e18 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.876180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c086fbe-bdb3-4b17-b892-e226f3b32e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.876458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c086fbe-bdb3-4b17-b892-e226f3b32e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-3ff27db9-860a-4904-8697-fafe53da6b5e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:22.886359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:22.887614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:22.888678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:22.889549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c086fbe-bdb3-4b17-b892-e226f3b32e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:22.889549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c086fbe-bdb3-4b17-b892-e226f3b32e18 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:22.893170 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 353/709] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/services/network => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:22.898899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff27db9-860a-4904-8697-fafe53da6b5e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-7c086fbe-bdb3-4b17-b892-e226f3b32e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:22.904566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:22.905702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:22.906856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:22.906856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:22.906856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:22.906856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 357/710] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:22.915155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c086fbe-bdb3-4b17-b892-e226f3b32e18 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.953075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:22.957187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.017590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff27db9-860a-4904-8697-fafe53da6b5e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.049591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c086fbe-bdb3-4b17-b892-e226f3b32e18 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.054004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cafd9e-8e44-43df-b889-39582ceaeac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.054713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cafd9e-8e44-43df-b889-39582ceaeac3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.055059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cafd9e-8e44-43df-b889-39582ceaeac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.055396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cafd9e-8e44-43df-b889-39582ceaeac3 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.056094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cafd9e-8e44-43df-b889-39582ceaeac3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.056465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cafd9e-8e44-43df-b889-39582ceaeac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.057895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cafd9e-8e44-43df-b889-39582ceaeac3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.063146 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 354/711] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:23.064018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cafd9e-8e44-43df-b889-39582ceaeac3 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.093093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5cee4-b713-4089-837f-f09f68bb9c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.093913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5cee4-b713-4089-837f-f09f68bb9c51 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.094284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5cee4-b713-4089-837f-f09f68bb9c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.094626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5cee4-b713-4089-837f-f09f68bb9c51 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.095384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5cee4-b713-4089-837f-f09f68bb9c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.095761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5cee4-b713-4089-837f-f09f68bb9c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.098041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5cee4-b713-4089-837f-f09f68bb9c51 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.110930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 358/712] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:23.111948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5cee4-b713-4089-837f-f09f68bb9c51 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.201930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cafd9e-8e44-43df-b889-39582ceaeac3 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.205096 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.229717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.238527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f69035-86e5-404c-823d-960e9d7a9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.239303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f69035-86e5-404c-823d-960e9d7a9106 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.239686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f69035-86e5-404c-823d-960e9d7a9106 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.240059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f69035-86e5-404c-823d-960e9d7a9106 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.240639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5cee4-b713-4089-837f-f09f68bb9c51 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.240915 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f69035-86e5-404c-823d-960e9d7a9106 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.242493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f69035-86e5-404c-823d-960e9d7a9106 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-83f69035-86e5-404c-823d-960e9d7a9106 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:23.252379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:23.254394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:23.255587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:23.261741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 355/713] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:23.261741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f69035-86e5-404c-823d-960e9d7a9106 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.290696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5727bd-185c-419d-bc90-d6b15c667c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.291808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5727bd-185c-419d-bc90-d6b15c667c5b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.292651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5727bd-185c-419d-bc90-d6b15c667c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.293242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5727bd-185c-419d-bc90-d6b15c667c5b None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.294133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5727bd-185c-419d-bc90-d6b15c667c5b None admin] RBAC: Adding query filter params (type=network) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.294654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5727bd-185c-419d-bc90-d6b15c667c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.297317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5727bd-185c-419d-bc90-d6b15c667c5b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.314974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 359/714] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:23.314974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5727bd-185c-419d-bc90-d6b15c667c5b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.437495 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f69035-86e5-404c-823d-960e9d7a9106 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.499453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d621f6-78ad-40bc-ae0d-3344aa0c3157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.500572 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d621f6-78ad-40bc-ae0d-3344aa0c3157 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.501131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d621f6-78ad-40bc-ae0d-3344aa0c3157 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.501636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d621f6-78ad-40bc-ae0d-3344aa0c3157 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.507473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5727bd-185c-419d-bc90-d6b15c667c5b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.511638 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d621f6-78ad-40bc-ae0d-3344aa0c3157 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.513319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d621f6-78ad-40bc-ae0d-3344aa0c3157 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-74d621f6-78ad-40bc-ae0d-3344aa0c3157 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:23.526800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:23.527761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:23.528719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:23.528719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:23.528719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:23.528719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:23.528719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:23.528719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:23.528719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:23.528719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:23.531283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 356/715] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:23.539327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d621f6-78ad-40bc-ae0d-3344aa0c3157 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.555561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769637a-5512-4b63-ac2f-5641e5257107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.556135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769637a-5512-4b63-ac2f-5641e5257107 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.556493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769637a-5512-4b63-ac2f-5641e5257107 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.556866 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769637a-5512-4b63-ac2f-5641e5257107 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.557580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769637a-5512-4b63-ac2f-5641e5257107 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.558297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769637a-5512-4b63-ac2f-5641e5257107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.559767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769637a-5512-4b63-ac2f-5641e5257107 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.565905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 360/716] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:23.572555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769637a-5512-4b63-ac2f-5641e5257107 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.588242 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.607868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.669240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d621f6-78ad-40bc-ae0d-3344aa0c3157 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.714288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0b1c2-c341-46ff-83b4-d94931c6d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.714907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0b1c2-c341-46ff-83b4-d94931c6d28c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.715191 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0b1c2-c341-46ff-83b4-d94931c6d28c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.715521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0b1c2-c341-46ff-83b4-d94931c6d28c None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.716231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0b1c2-c341-46ff-83b4-d94931c6d28c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.716538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0b1c2-c341-46ff-83b4-d94931c6d28c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.718160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0b1c2-c341-46ff-83b4-d94931c6d28c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.748242 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 357/717] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:23.751129 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769637a-5512-4b63-ac2f-5641e5257107 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.755227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0b1c2-c341-46ff-83b4-d94931c6d28c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.832608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0169b6-8359-45c0-a5be-774d256f642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.833157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0169b6-8359-45c0-a5be-774d256f642c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.833439 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0169b6-8359-45c0-a5be-774d256f642c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.833714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0169b6-8359-45c0-a5be-774d256f642c None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.834375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0169b6-8359-45c0-a5be-774d256f642c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.834681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0169b6-8359-45c0-a5be-774d256f642c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.836068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0169b6-8359-45c0-a5be-774d256f642c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.850836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 361/718] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:23.866895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.886552 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0b1c2-c341-46ff-83b4-d94931c6d28c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.944412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448d97e-067f-4e2b-b452-a92f3f28222c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.945112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448d97e-067f-4e2b-b452-a92f3f28222c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.945397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448d97e-067f-4e2b-b452-a92f3f28222c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.945673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448d97e-067f-4e2b-b452-a92f3f28222c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.946434 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448d97e-067f-4e2b-b452-a92f3f28222c None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=656ce4b09cf6425193b7e58562ccaced) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.946752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448d97e-067f-4e2b-b452-a92f3f28222c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.948197 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448d97e-067f-4e2b-b452-a92f3f28222c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.959593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 358/719] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/role_assignments?user.id=656ce4b09cf6425193b7e58562ccaced&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:24.021892 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685ef2c-3b82-411f-b3bd-fef6f62e517d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:24.022469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685ef2c-3b82-411f-b3bd-fef6f62e517d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:24.022469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685ef2c-3b82-411f-b3bd-fef6f62e517d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:24.024165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 362/720] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:24.029766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0faeae-b621-4d7d-85ae-37ebe3c20858 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:24.030084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0faeae-b621-4d7d-85ae-37ebe3c20858 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:24.030354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0faeae-b621-4d7d-85ae-37ebe3c20858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:24.056401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-9c0faeae-b621-4d7d-85ae-37ebe3c20858 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:24.057644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9c0faeae-b621-4d7d-85ae-37ebe3c20858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:24.159148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 359/721] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:24.179446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52712b-007e-4ad9-90fd-304565a6266a None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:24.179736 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52712b-007e-4ad9-90fd-304565a6266a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:24.180013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52712b-007e-4ad9-90fd-304565a6266a None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:24.181357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 363/722] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:24.188106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2717-de7b-4a28-8f46-eb3810bedc8b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:24.188390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2717-de7b-4a28-8f46-eb3810bedc8b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:24.188667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2717-de7b-4a28-8f46-eb3810bedc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:24.208814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6bfe2717-de7b-4a28-8f46-eb3810bedc8b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:24.210423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6bfe2717-de7b-4a28-8f46-eb3810bedc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:24.286037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 360/723] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:24.452183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52712b-007e-4ad9-90fd-304565a6266a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:24.557843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:24.568842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe2717-de7b-4a28-8f46-eb3810bedc8b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:24.576918 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52712b-007e-4ad9-90fd-304565a6266a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:24.591954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:24.641935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7649f-4488-4d04-b384-39a142b429d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:24.642611 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7649f-4488-4d04-b384-39a142b429d0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:24.642905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7649f-4488-4d04-b384-39a142b429d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:24.643170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7649f-4488-4d04-b384-39a142b429d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:24.663196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7649f-4488-4d04-b384-39a142b429d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-a5d7649f-4488-4d04-b384-39a142b429d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:24.668523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:24.669470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:24.670938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 364/724] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:24.676318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7649f-4488-4d04-b384-39a142b429d0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:24.745289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe2717-de7b-4a28-8f46-eb3810bedc8b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:24.796523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7649f-4488-4d04-b384-39a142b429d0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:24.821862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c1a94-5f6f-48c0-922a-891acf92e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:24.822543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c1a94-5f6f-48c0-922a-891acf92e749 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:24.822829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c1a94-5f6f-48c0-922a-891acf92e749 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:24.823107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c1a94-5f6f-48c0-922a-891acf92e749 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:24.834147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be0c59-8f30-452c-b27c-bbf73a9df72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:24.834792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be0c59-8f30-452c-b27c-bbf73a9df72f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:24.835075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be0c59-8f30-452c-b27c-bbf73a9df72f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:24.835347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be0c59-8f30-452c-b27c-bbf73a9df72f None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:24.836012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be0c59-8f30-452c-b27c-bbf73a9df72f None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:24.836318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be0c59-8f30-452c-b27c-bbf73a9df72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:24.837710 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be0c59-8f30-452c-b27c-bbf73a9df72f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:24.839854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c1a94-5f6f-48c0-922a-891acf92e749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-769c1a94-5f6f-48c0-922a-891acf92e749 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:24.844507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:24.845431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:24.846911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 361/725] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:24.853455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 365/726] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:24.858845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c1a94-5f6f-48c0-922a-891acf92e749 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:24.860008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be0c59-8f30-452c-b27c-bbf73a9df72f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:24.878617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:24.988487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:25.045569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c1a94-5f6f-48c0-922a-891acf92e749 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.065236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be0c59-8f30-452c-b27c-bbf73a9df72f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.122139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d681-d8fb-4a59-be59-68622420ee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.122818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d681-d8fb-4a59-be59-68622420ee3a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.123099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d681-d8fb-4a59-be59-68622420ee3a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.123373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d681-d8fb-4a59-be59-68622420ee3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.137683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd195d-2ac0-4df6-a6e8-c136fd2cbef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.138330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd195d-2ac0-4df6-a6e8-c136fd2cbef9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.138614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd195d-2ac0-4df6-a6e8-c136fd2cbef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.138892 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd195d-2ac0-4df6-a6e8-c136fd2cbef9 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.139567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd195d-2ac0-4df6-a6e8-c136fd2cbef9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:25.139874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd195d-2ac0-4df6-a6e8-c136fd2cbef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.141263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd195d-2ac0-4df6-a6e8-c136fd2cbef9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.145015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798d681-d8fb-4a59-be59-68622420ee3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.146509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798d681-d8fb-4a59-be59-68622420ee3a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.161188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 366/727] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:25.166453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd195d-2ac0-4df6-a6e8-c136fd2cbef9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-4798d681-d8fb-4a59-be59-68622420ee3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:25.183560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:25.185716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:25.190853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:25.190853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:25.190853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:25.190853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 362/728] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:25.190853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d681-d8fb-4a59-be59-68622420ee3a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.303539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:25.358837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd195d-2ac0-4df6-a6e8-c136fd2cbef9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.366229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d681-d8fb-4a59-be59-68622420ee3a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.393742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:25.396777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72327a07-752f-45e9-b1ed-de7c74c61008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.397673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72327a07-752f-45e9-b1ed-de7c74c61008 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.398133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72327a07-752f-45e9-b1ed-de7c74c61008 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.398639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72327a07-752f-45e9-b1ed-de7c74c61008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.405856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b60fac-4f5f-4950-a9ab-e614b20ceebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.406607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b60fac-4f5f-4950-a9ab-e614b20ceebc None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.406964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b60fac-4f5f-4950-a9ab-e614b20ceebc None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.407313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b60fac-4f5f-4950-a9ab-e614b20ceebc None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.408180 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b60fac-4f5f-4950-a9ab-e614b20ceebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:25.408433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b60fac-4f5f-4950-a9ab-e614b20ceebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.410537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b60fac-4f5f-4950-a9ab-e614b20ceebc None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.414027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72327a07-752f-45e9-b1ed-de7c74c61008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.415742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72327a07-752f-45e9-b1ed-de7c74c61008 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.424345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 363/729] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:25.431577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b60fac-4f5f-4950-a9ab-e614b20ceebc None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-72327a07-752f-45e9-b1ed-de7c74c61008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:25.436650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:25.437595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:25.438547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:25.438547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:25.438547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:25.441406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 367/730] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:25.446675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72327a07-752f-45e9-b1ed-de7c74c61008 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.565651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b60fac-4f5f-4950-a9ab-e614b20ceebc None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.608315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7da3ba-90ad-4ff5-92d1-f89f3979dc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.608946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7da3ba-90ad-4ff5-92d1-f89f3979dc73 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.609223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7da3ba-90ad-4ff5-92d1-f89f3979dc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.609495 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7da3ba-90ad-4ff5-92d1-f89f3979dc73 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.616846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72327a07-752f-45e9-b1ed-de7c74c61008 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.620810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7da3ba-90ad-4ff5-92d1-f89f3979dc73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.622722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7da3ba-90ad-4ff5-92d1-f89f3979dc73 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-0c7da3ba-90ad-4ff5-92d1-f89f3979dc73 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:25.638336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:25.639360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:25.640345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:25.640345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:25.640345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:25.640345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:25.640345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:25.640345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:25.640345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:25.640345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:25.640345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:25.640345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:25.644227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 364/731] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:25.645538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735ae2-56d6-453d-964a-e2a8770965d5 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.645823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735ae2-56d6-453d-964a-e2a8770965d5 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.646098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735ae2-56d6-453d-964a-e2a8770965d5 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.651606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 365/732] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:25.652557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:25.653479 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735ae2-56d6-453d-964a-e2a8770965d5 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.664531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c85ea8-77c5-4ddc-bc7e-50f1df1b5508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.665262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c85ea8-77c5-4ddc-bc7e-50f1df1b5508 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.665604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c85ea8-77c5-4ddc-bc7e-50f1df1b5508 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.668007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c85ea8-77c5-4ddc-bc7e-50f1df1b5508 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.668007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c85ea8-77c5-4ddc-bc7e-50f1df1b5508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:25.668007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c85ea8-77c5-4ddc-bc7e-50f1df1b5508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.669506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c85ea8-77c5-4ddc-bc7e-50f1df1b5508 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.683029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 368/733] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:25.684666 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6528-8476-4d20-9837-ecab38712ebb None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.685027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6528-8476-4d20-9837-ecab38712ebb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.685401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6528-8476-4d20-9837-ecab38712ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.705426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-60de6528-8476-4d20-9837-ecab38712ebb None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:25.706448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:25.708844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-60de6528-8476-4d20-9837-ecab38712ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:25.767169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735ae2-56d6-453d-964a-e2a8770965d5 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.790532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 369/734] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:25.791757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6528-8476-4d20-9837-ecab38712ebb None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.809730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bccc76-cd2d-4ff1-9031-601af13bebb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.810656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bccc76-cd2d-4ff1-9031-601af13bebb5 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.811267 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bccc76-cd2d-4ff1-9031-601af13bebb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.811686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bccc76-cd2d-4ff1-9031-601af13bebb5 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.812583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bccc76-cd2d-4ff1-9031-601af13bebb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:25.813061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bccc76-cd2d-4ff1-9031-601af13bebb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.814683 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bccc76-cd2d-4ff1-9031-601af13bebb5 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.834953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 366/735] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:25.840340 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bccc76-cd2d-4ff1-9031-601af13bebb5 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.983391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bccc76-cd2d-4ff1-9031-601af13bebb5 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.984934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:25.986996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6528-8476-4d20-9837-ecab38712ebb None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.009946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.027554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa142707-ecdb-44bc-9f75-153c766765ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.028750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa142707-ecdb-44bc-9f75-153c766765ff None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.029183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa142707-ecdb-44bc-9f75-153c766765ff None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.029609 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa142707-ecdb-44bc-9f75-153c766765ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.067658 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1265a-aec1-460f-ae9d-444c7ec3f801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.068216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1265a-aec1-460f-ae9d-444c7ec3f801 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.068308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1265a-aec1-460f-ae9d-444c7ec3f801 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.068520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1265a-aec1-460f-ae9d-444c7ec3f801 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.083360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1265a-aec1-460f-ae9d-444c7ec3f801 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.084869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1265a-aec1-460f-ae9d-444c7ec3f801 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.103825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa142707-ecdb-44bc-9f75-153c766765ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.105690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa142707-ecdb-44bc-9f75-153c766765ff None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-1de1265a-aec1-460f-ae9d-444c7ec3f801 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:26.111930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:26.112914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:26.113867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:26.113867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:26.113867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:26.113867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:26.113867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:26.113867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:26.113867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:26.113867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:26.113867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:26.113867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:26.116559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 370/736] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:26.117634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1265a-aec1-460f-ae9d-444c7ec3f801 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.214557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 367/737] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:27:26.215244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa142707-ecdb-44bc-9f75-153c766765ff None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.222017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.229111 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1265a-aec1-460f-ae9d-444c7ec3f801 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.265467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827159f-d537-4d47-8d2e-c50cbb25514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.266262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827159f-d537-4d47-8d2e-c50cbb25514b None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.266686 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827159f-d537-4d47-8d2e-c50cbb25514b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.267062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827159f-d537-4d47-8d2e-c50cbb25514b None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.267816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827159f-d537-4d47-8d2e-c50cbb25514b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.269529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827159f-d537-4d47-8d2e-c50cbb25514b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.327664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa142707-ecdb-44bc-9f75-153c766765ff None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.366078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06687693-a5bb-46ad-bfb1-2e1dfa5fb284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.366634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06687693-a5bb-46ad-bfb1-2e1dfa5fb284 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.366916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06687693-a5bb-46ad-bfb1-2e1dfa5fb284 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.367193 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06687693-a5bb-46ad-bfb1-2e1dfa5fb284 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.367973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06687693-a5bb-46ad-bfb1-2e1dfa5fb284 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:26.368286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06687693-a5bb-46ad-bfb1-2e1dfa5fb284 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.369826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06687693-a5bb-46ad-bfb1-2e1dfa5fb284 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.394814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 371/738] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:26 2022] POST /identity/v3/services => generated 240 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:26.395868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827159f-d537-4d47-8d2e-c50cbb25514b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.397357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 368/739] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:26.402940 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06687693-a5bb-46ad-bfb1-2e1dfa5fb284 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.442207 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.482061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.528078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827159f-d537-4d47-8d2e-c50cbb25514b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.532556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06687693-a5bb-46ad-bfb1-2e1dfa5fb284 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.570651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083adba-9be5-405a-be45-59b8bd437ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.571285 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083adba-9be5-405a-be45-59b8bd437ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.571568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083adba-9be5-405a-be45-59b8bd437ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.571842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083adba-9be5-405a-be45-59b8bd437ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.583681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083adba-9be5-405a-be45-59b8bd437ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.585131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083adba-9be5-405a-be45-59b8bd437ce4 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-5083adba-9be5-405a-be45-59b8bd437ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:26.600451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:26.601462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:26.602504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:26.602504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:26.602504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:26.602504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 369/740] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:26.603158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1687cc-a302-49ad-b7e6-5ff63988dc86 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.603158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1687cc-a302-49ad-b7e6-5ff63988dc86 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.603449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1687cc-a302-49ad-b7e6-5ff63988dc86 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.605599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 370/741] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:26.605944 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147386-4698-4883-a015-43109a0183b9 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.606246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147386-4698-4883-a015-43109a0183b9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.606525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147386-4698-4883-a015-43109a0183b9 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.607932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 371/742] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:26.613372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711eca5-7871-43d0-96ae-52c983f797bd None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.613372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711eca5-7871-43d0-96ae-52c983f797bd None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.613372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711eca5-7871-43d0-96ae-52c983f797bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.631446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6711eca5-7871-43d0-96ae-52c983f797bd None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:26.632554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6711eca5-7871-43d0-96ae-52c983f797bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:26.637089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020d201-539e-4d10-8d17-b19d59a63d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.637908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d201-539e-4d10-8d17-b19d59a63d16 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.638385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d201-539e-4d10-8d17-b19d59a63d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.638810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d201-539e-4d10-8d17-b19d59a63d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.652542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020d201-539e-4d10-8d17-b19d59a63d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.654945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020d201-539e-4d10-8d17-b19d59a63d16 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-e020d201-539e-4d10-8d17-b19d59a63d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:26.672836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:26.673843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:26.674817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:26.674817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:26.674817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:26.678306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 372/743] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:26.679020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020d201-539e-4d10-8d17-b19d59a63d16 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.706367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 372/744] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:26 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:26.719558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de829368-0aef-40c2-b3ab-3484d9b768b8 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.719845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de829368-0aef-40c2-b3ab-3484d9b768b8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.720117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de829368-0aef-40c2-b3ab-3484d9b768b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.742627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-de829368-0aef-40c2-b3ab-3484d9b768b8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:26.743802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-de829368-0aef-40c2-b3ab-3484d9b768b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:26.778559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.783077 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.797935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020d201-539e-4d10-8d17-b19d59a63d16 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.816568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 373/745] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:26 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:26.817766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de829368-0aef-40c2-b3ab-3484d9b768b8 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.833663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8012fb1-149e-42f4-99fd-2d1a47c1e5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.834404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012fb1-149e-42f4-99fd-2d1a47c1e5ad None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.834765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012fb1-149e-42f4-99fd-2d1a47c1e5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.835114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012fb1-149e-42f4-99fd-2d1a47c1e5ad None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.835833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8012fb1-149e-42f4-99fd-2d1a47c1e5ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:26.836210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8012fb1-149e-42f4-99fd-2d1a47c1e5ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.837661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8012fb1-149e-42f4-99fd-2d1a47c1e5ad None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.850324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 373/746] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:26.855864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8012fb1-149e-42f4-99fd-2d1a47c1e5ad None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.945367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de829368-0aef-40c2-b3ab-3484d9b768b8 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.985612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ac7e-b1a2-4e70-8673-57b00796006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.986232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ac7e-b1a2-4e70-8673-57b00796006c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.986515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ac7e-b1a2-4e70-8673-57b00796006c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.986784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ac7e-b1a2-4e70-8673-57b00796006c None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.987422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0ac7e-b1a2-4e70-8673-57b00796006c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:26.987777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0ac7e-b1a2-4e70-8673-57b00796006c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.990308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0ac7e-b1a2-4e70-8673-57b00796006c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.002233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 374/747] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:27.015532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ac7e-b1a2-4e70-8673-57b00796006c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.035263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8012fb1-149e-42f4-99fd-2d1a47c1e5ad None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.066554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.071258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79ee46-4298-4db7-9aca-64c4fdbb9845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.072010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ee46-4298-4db7-9aca-64c4fdbb9845 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.072390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ee46-4298-4db7-9aca-64c4fdbb9845 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.072768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ee46-4298-4db7-9aca-64c4fdbb9845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.079874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79ee46-4298-4db7-9aca-64c4fdbb9845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.081488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79ee46-4298-4db7-9aca-64c4fdbb9845 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.083942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-dd79ee46-4298-4db7-9aca-64c4fdbb9845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:27.096685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:27.098138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:27.099553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:27.099553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:27.099553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:27.099553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:27.099553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:27.099553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:27.099553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:27.099553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:27.102508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 374/748] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:27.103807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79ee46-4298-4db7-9aca-64c4fdbb9845 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.157806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ac7e-b1a2-4e70-8673-57b00796006c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.200491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c32eba-94ee-4257-b4f3-dcda06b064f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.201138 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32eba-94ee-4257-b4f3-dcda06b064f9 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.201415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32eba-94ee-4257-b4f3-dcda06b064f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.201687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32eba-94ee-4257-b4f3-dcda06b064f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.209036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c32eba-94ee-4257-b4f3-dcda06b064f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.210733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c32eba-94ee-4257-b4f3-dcda06b064f9 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-73c32eba-94ee-4257-b4f3-dcda06b064f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:27.222671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:27.223560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:27.224453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:27.224453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:27.224453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:27.224453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:27.224453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:27.224453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:27.224453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:27.224453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:27.224453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 375/749] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:27.224944 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c32eba-94ee-4257-b4f3-dcda06b064f9 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.230580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79ee46-4298-4db7-9aca-64c4fdbb9845 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.264428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07750-4dca-4ac2-a7d6-844e0614d2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.265044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07750-4dca-4ac2-a7d6-844e0614d2df None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.265333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07750-4dca-4ac2-a7d6-844e0614d2df None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.265620 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07750-4dca-4ac2-a7d6-844e0614d2df None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.266294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07750-4dca-4ac2-a7d6-844e0614d2df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.267696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07750-4dca-4ac2-a7d6-844e0614d2df None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.316576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.324741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c32eba-94ee-4257-b4f3-dcda06b064f9 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.341757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 375/750] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:27 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:27.342811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07750-4dca-4ac2-a7d6-844e0614d2df None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.388756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589485f4-be59-4d8d-beb3-ed00c7124642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.389689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589485f4-be59-4d8d-beb3-ed00c7124642 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.390249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589485f4-be59-4d8d-beb3-ed00c7124642 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.390761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589485f4-be59-4d8d-beb3-ed00c7124642 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.391910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589485f4-be59-4d8d-beb3-ed00c7124642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:27.392556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589485f4-be59-4d8d-beb3-ed00c7124642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.394928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589485f4-be59-4d8d-beb3-ed00c7124642 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.409067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 376/751] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:27.410936 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589485f4-be59-4d8d-beb3-ed00c7124642 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.425675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.474527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07750-4dca-4ac2-a7d6-844e0614d2df None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.522422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def8ae5-730f-47b8-aa75-520531c45ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.523066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def8ae5-730f-47b8-aa75-520531c45ebe None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.523397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def8ae5-730f-47b8-aa75-520531c45ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.523681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def8ae5-730f-47b8-aa75-520531c45ebe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.536063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589485f4-be59-4d8d-beb3-ed00c7124642 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.540356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def8ae5-730f-47b8-aa75-520531c45ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3def8ae5-730f-47b8-aa75-520531c45ebe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:27.546429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:27.551602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 376/752] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:27.552478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def8ae5-730f-47b8-aa75-520531c45ebe None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.584059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d7f04-e631-4ff2-8be1-5ce9e30190a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.584987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7f04-e631-4ff2-8be1-5ce9e30190a7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.585501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7f04-e631-4ff2-8be1-5ce9e30190a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.585981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7f04-e631-4ff2-8be1-5ce9e30190a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.586933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d7f04-e631-4ff2-8be1-5ce9e30190a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:27.587463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d7f04-e631-4ff2-8be1-5ce9e30190a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.589145 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d7f04-e631-4ff2-8be1-5ce9e30190a7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.604915 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 377/753] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:27.606090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d7f04-e631-4ff2-8be1-5ce9e30190a7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.620833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.693830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def8ae5-730f-47b8-aa75-520531c45ebe None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.718374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.724110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d7f04-e631-4ff2-8be1-5ce9e30190a7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.744164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60085668-1abf-4856-844a-00aa1a8e2878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.745145 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60085668-1abf-4856-844a-00aa1a8e2878 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.745650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60085668-1abf-4856-844a-00aa1a8e2878 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.746128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60085668-1abf-4856-844a-00aa1a8e2878 None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/9e2f71ebeca2441791a0241de737cad0/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.750426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60085668-1abf-4856-844a-00aa1a8e2878 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=9e2f71ebeca2441791a0241de737cad0, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.752561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60085668-1abf-4856-844a-00aa1a8e2878 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.765540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb396-062c-4523-abe6-475b4358f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.774339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb396-062c-4523-abe6-475b4358f1ac None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.774339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb396-062c-4523-abe6-475b4358f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.774339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb396-062c-4523-abe6-475b4358f1ac None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.774339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb396-062c-4523-abe6-475b4358f1ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:27.774339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb396-062c-4523-abe6-475b4358f1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.774339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb396-062c-4523-abe6-475b4358f1ac None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.782303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 378/754] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:27.782303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb396-062c-4523-abe6-475b4358f1ac None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.833632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 377/755] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:27 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/9e2f71ebeca2441791a0241de737cad0/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:27.835770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60085668-1abf-4856-844a-00aa1a8e2878 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.885891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.915498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb396-062c-4523-abe6-475b4358f1ac None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.955713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af59c2-0411-492a-a86d-2edcbf3a0cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.956344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af59c2-0411-492a-a86d-2edcbf3a0cdb None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.957349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af59c2-0411-492a-a86d-2edcbf3a0cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.957735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af59c2-0411-492a-a86d-2edcbf3a0cdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.959041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af59c2-0411-492a-a86d-2edcbf3a0cdb None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=be2fc683522941169708877bcfe2dc56) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:27.959551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af59c2-0411-492a-a86d-2edcbf3a0cdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.961139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af59c2-0411-492a-a86d-2edcbf3a0cdb None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.968496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 379/756] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/role_assignments?user.id=be2fc683522941169708877bcfe2dc56&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:28.039264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60085668-1abf-4856-844a-00aa1a8e2878 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.079743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e9c64-1ef9-4d10-a518-dd4acf61ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.080383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9c64-1ef9-4d10-a518-dd4acf61ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.080668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9c64-1ef9-4d10-a518-dd4acf61ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.080939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9c64-1ef9-4d10-a518-dd4acf61ffe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.093267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e9c64-1ef9-4d10-a518-dd4acf61ffe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.094863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e9c64-1ef9-4d10-a518-dd4acf61ffe4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-240e9c64-1ef9-4d10-a518-dd4acf61ffe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:28.111360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:28.112400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:28.114696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:28.114696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:28.114696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:28.114696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 378/757] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:28.120769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af59c2-0411-492a-a86d-2edcbf3a0cdb None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.244924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af59c2-0411-492a-a86d-2edcbf3a0cdb None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.286174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dfe6c-f4b0-42da-b680-97287e292181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.286909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dfe6c-f4b0-42da-b680-97287e292181 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.287189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dfe6c-f4b0-42da-b680-97287e292181 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.287510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dfe6c-f4b0-42da-b680-97287e292181 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.288163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dfe6c-f4b0-42da-b680-97287e292181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:28.288467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dfe6c-f4b0-42da-b680-97287e292181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.289957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dfe6c-f4b0-42da-b680-97287e292181 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.291446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.307867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 380/758] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:28.312995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e9c64-1ef9-4d10-a518-dd4acf61ffe4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.365515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.469072 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e9c64-1ef9-4d10-a518-dd4acf61ffe4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.503239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f787-b113-4aaf-b0e7-e04fbd9855fe None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.504073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f787-b113-4aaf-b0e7-e04fbd9855fe None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.504342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f787-b113-4aaf-b0e7-e04fbd9855fe None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.505911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 381/759] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:28.511430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37051d-73c1-4e40-8613-e00439731305 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.514754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37051d-73c1-4e40-8613-e00439731305 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.514754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37051d-73c1-4e40-8613-e00439731305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.514955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e58531-f06a-46f6-890d-13ef961c7723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.515574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e58531-f06a-46f6-890d-13ef961c7723 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.515867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e58531-f06a-46f6-890d-13ef961c7723 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.516243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e58531-f06a-46f6-890d-13ef961c7723 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.531546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e58531-f06a-46f6-890d-13ef961c7723 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.533044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e58531-f06a-46f6-890d-13ef961c7723 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.534363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7b37051d-73c1-4e40-8613-e00439731305 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:28.536523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7b37051d-73c1-4e40-8613-e00439731305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f6e58531-f06a-46f6-890d-13ef961c7723 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:28.560942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:28.562162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:28.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:28.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:28.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:28.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:28.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:28.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:28.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:28.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:28.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:28.563235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:28.566432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 379/760] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:28.568454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e58531-f06a-46f6-890d-13ef961c7723 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.677073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 382/761] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:28.722721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.725916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e58531-f06a-46f6-890d-13ef961c7723 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.765599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51d412-fb14-4d34-aed9-4636964e73ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.766252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51d412-fb14-4d34-aed9-4636964e73ad None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.766542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51d412-fb14-4d34-aed9-4636964e73ad None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.766821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51d412-fb14-4d34-aed9-4636964e73ad None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.767549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51d412-fb14-4d34-aed9-4636964e73ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:28.767851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51d412-fb14-4d34-aed9-4636964e73ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.769822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51d412-fb14-4d34-aed9-4636964e73ad None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.787604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 380/762] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:28.792871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37051d-73c1-4e40-8613-e00439731305 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.927647 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37051d-73c1-4e40-8613-e00439731305 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.964599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.975397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b13d32-e990-4dc2-8fbf-dc3a68908c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.976018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b13d32-e990-4dc2-8fbf-dc3a68908c31 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.976302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b13d32-e990-4dc2-8fbf-dc3a68908c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.978307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b13d32-e990-4dc2-8fbf-dc3a68908c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.014902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51d412-fb14-4d34-aed9-4636964e73ad None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.096445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b13d32-e990-4dc2-8fbf-dc3a68908c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.100099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b13d32-e990-4dc2-8fbf-dc3a68908c31 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.168731 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51d412-fb14-4d34-aed9-4636964e73ad None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.251612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fe644-d9c8-49c5-9e68-360333f30995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.252260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fe644-d9c8-49c5-9e68-360333f30995 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.252542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fe644-d9c8-49c5-9e68-360333f30995 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.252818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fe644-d9c8-49c5-9e68-360333f30995 None admin] PATH_INFO: `/v3/services/network` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.254077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fe644-d9c8-49c5-9e68-360333f30995 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.255530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fe644-d9c8-49c5-9e68-360333f30995 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.262810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 383/763] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:27:29.268761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b13d32-e990-4dc2-8fbf-dc3a68908c31 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-843fe644-d9c8-49c5-9e68-360333f30995 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:29.275024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:29.276039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:29.276915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:29.278697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 381/764] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:29.282639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fe644-d9c8-49c5-9e68-360333f30995 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.298808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.312560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.391447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fe644-d9c8-49c5-9e68-360333f30995 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.427527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3454721-a6f4-4a27-b962-29c2abedc891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.428150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3454721-a6f4-4a27-b962-29c2abedc891 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.428433 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3454721-a6f4-4a27-b962-29c2abedc891 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.428710 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3454721-a6f4-4a27-b962-29c2abedc891 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.429397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3454721-a6f4-4a27-b962-29c2abedc891 None admin] RBAC: Adding query filter params (name=network) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:29.429652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3454721-a6f4-4a27-b962-29c2abedc891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.431090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3454721-a6f4-4a27-b962-29c2abedc891 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.436094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 382/765] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:29.439628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b13d32-e990-4dc2-8fbf-dc3a68908c31 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.442543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3454721-a6f4-4a27-b962-29c2abedc891 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.500014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd71c46-ba98-4ce1-bf50-106da4e1919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.500656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd71c46-ba98-4ce1-bf50-106da4e1919e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.500935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd71c46-ba98-4ce1-bf50-106da4e1919e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.501208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd71c46-ba98-4ce1-bf50-106da4e1919e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.523500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd71c46-ba98-4ce1-bf50-106da4e1919e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.524789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.524974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd71c46-ba98-4ce1-bf50-106da4e1919e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.549704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3454721-a6f4-4a27-b962-29c2abedc891 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-6cd71c46-ba98-4ce1-bf50-106da4e1919e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:29.555064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:29.556252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:29.557493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:29.557493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:29.557493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:29.562406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 384/766] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:29.563192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd71c46-ba98-4ce1-bf50-106da4e1919e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.592205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c76be-b04d-4850-9097-e757b506679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.593176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c76be-b04d-4850-9097-e757b506679a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.593610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c76be-b04d-4850-9097-e757b506679a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.594037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c76be-b04d-4850-9097-e757b506679a None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.594833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c76be-b04d-4850-9097-e757b506679a None admin] RBAC: Adding query filter params (type=network) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:29.595286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c76be-b04d-4850-9097-e757b506679a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.596820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c76be-b04d-4850-9097-e757b506679a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.602672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 383/767] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:29.608480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c76be-b04d-4850-9097-e757b506679a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.720270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c76be-b04d-4850-9097-e757b506679a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.750888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.758909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c1070-8f7e-4eb8-97f7-a49b6928cceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.759546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c1070-8f7e-4eb8-97f7-a49b6928cceb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.759831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c1070-8f7e-4eb8-97f7-a49b6928cceb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.760105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c1070-8f7e-4eb8-97f7-a49b6928cceb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.760809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c1070-8f7e-4eb8-97f7-a49b6928cceb None admin] RBAC: Adding query filter params (interface=public, service_id=2a7d5b8d5879442791f05e042b88f459, region_id=RegionOne) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:29.761122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c1070-8f7e-4eb8-97f7-a49b6928cceb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.762543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c1070-8f7e-4eb8-97f7-a49b6928cceb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.769755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd71c46-ba98-4ce1-bf50-106da4e1919e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.771641 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 384/768] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/endpoints?service_id=2a7d5b8d5879442791f05e042b88f459&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:29.775167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3904b6-fa5e-44ee-8c53-265ddfd0fd33 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.775466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3904b6-fa5e-44ee-8c53-265ddfd0fd33 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.775753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3904b6-fa5e-44ee-8c53-265ddfd0fd33 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.781203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 385/769] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:29.781203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3904b6-fa5e-44ee-8c53-265ddfd0fd33 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.783729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.810492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a0257-8ffa-416d-9211-175da0c29e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.811480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a0257-8ffa-416d-9211-175da0c29e7c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.811949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a0257-8ffa-416d-9211-175da0c29e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.812401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a0257-8ffa-416d-9211-175da0c29e7c None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.813222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a0257-8ffa-416d-9211-175da0c29e7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:29.813717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a0257-8ffa-416d-9211-175da0c29e7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.815640 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a0257-8ffa-416d-9211-175da0c29e7c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.829699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 385/770] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:29.831245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356662-a162-47ca-bf2a-73f94b8c8b61 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.831765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356662-a162-47ca-bf2a-73f94b8c8b61 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.832278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356662-a162-47ca-bf2a-73f94b8c8b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.850939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c0356662-a162-47ca-bf2a-73f94b8c8b61 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:29.852427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c0356662-a162-47ca-bf2a-73f94b8c8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:29.890322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3904b6-fa5e-44ee-8c53-265ddfd0fd33 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.926465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 386/771] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:29.927208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356662-a162-47ca-bf2a-73f94b8c8b61 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.934922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebb4c9-02b0-429a-9e9d-acca0787909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.936484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebb4c9-02b0-429a-9e9d-acca0787909a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.936765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebb4c9-02b0-429a-9e9d-acca0787909a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.937039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebb4c9-02b0-429a-9e9d-acca0787909a None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.937652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebb4c9-02b0-429a-9e9d-acca0787909a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.942515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebb4c9-02b0-429a-9e9d-acca0787909a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.962364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 386/772] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:30.042400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.095951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356662-a162-47ca-bf2a-73f94b8c8b61 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.110570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e78ad-b2ef-46f3-ad13-48764f116260 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.110927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e78ad-b2ef-46f3-ad13-48764f116260 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.111125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e78ad-b2ef-46f3-ad13-48764f116260 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.112757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 387/773] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:30.118575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49746a0-f9f8-4c0e-8007-2c67bbe6a8ba None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.118864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49746a0-f9f8-4c0e-8007-2c67bbe6a8ba None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.119140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49746a0-f9f8-4c0e-8007-2c67bbe6a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.138995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d49746a0-f9f8-4c0e-8007-2c67bbe6a8ba None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:30.140277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d49746a0-f9f8-4c0e-8007-2c67bbe6a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:30.208035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff53a-238c-4061-a9b0-d9c25139acad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.209081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff53a-238c-4061-a9b0-d9c25139acad None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.209599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff53a-238c-4061-a9b0-d9c25139acad None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.210094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff53a-238c-4061-a9b0-d9c25139acad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.213235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.218506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ff53a-238c-4061-a9b0-d9c25139acad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.219805 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 388/774] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:30.220548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ff53a-238c-4061-a9b0-d9c25139acad None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.220659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49746a0-f9f8-4c0e-8007-2c67bbe6a8ba None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-909ff53a-238c-4061-a9b0-d9c25139acad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:30.232973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:30.246375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:30.247500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:30.247500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:30.247500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:30.247500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:30.247500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:30.247500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:30.247500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:30.247500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:30.247500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 387/775] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:30.249285 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff53a-238c-4061-a9b0-d9c25139acad None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.337096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49746a0-f9f8-4c0e-8007-2c67bbe6a8ba None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.382217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a7c7-5bc6-4dba-b8c5-17556ed3d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.382217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a7c7-5bc6-4dba-b8c5-17556ed3d172 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.382217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a7c7-5bc6-4dba-b8c5-17556ed3d172 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.382217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a7c7-5bc6-4dba-b8c5-17556ed3d172 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.382651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164a7c7-5bc6-4dba-b8c5-17556ed3d172 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.384034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164a7c7-5bc6-4dba-b8c5-17556ed3d172 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b164a7c7-5bc6-4dba-b8c5-17556ed3d172 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:30.395369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:30.396520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:30.397535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 389/776] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:30.402273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a7c7-5bc6-4dba-b8c5-17556ed3d172 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.411325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff53a-238c-4061-a9b0-d9c25139acad None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.473746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.489798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.515141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1230f6-4ff0-4a0b-8109-570157d5f907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.515943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1230f6-4ff0-4a0b-8109-570157d5f907 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.516326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1230f6-4ff0-4a0b-8109-570157d5f907 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.516700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1230f6-4ff0-4a0b-8109-570157d5f907 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.517506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1230f6-4ff0-4a0b-8109-570157d5f907 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:30.517911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1230f6-4ff0-4a0b-8109-570157d5f907 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.520059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1230f6-4ff0-4a0b-8109-570157d5f907 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.525903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a7c7-5bc6-4dba-b8c5-17556ed3d172 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.532622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 388/777] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:30.533600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1230f6-4ff0-4a0b-8109-570157d5f907 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.573139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aba11-7ce2-4eef-b87d-5dfc1e7977e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.573762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aba11-7ce2-4eef-b87d-5dfc1e7977e0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.574045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aba11-7ce2-4eef-b87d-5dfc1e7977e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.574367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aba11-7ce2-4eef-b87d-5dfc1e7977e0 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.575116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aba11-7ce2-4eef-b87d-5dfc1e7977e0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:30.575435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aba11-7ce2-4eef-b87d-5dfc1e7977e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.577415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aba11-7ce2-4eef-b87d-5dfc1e7977e0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.584517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 390/778] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:30.586939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aba11-7ce2-4eef-b87d-5dfc1e7977e0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.655026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1230f6-4ff0-4a0b-8109-570157d5f907 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.693364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea07145-746c-4574-915a-6db53074beda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.694024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea07145-746c-4574-915a-6db53074beda None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.694333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea07145-746c-4574-915a-6db53074beda None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.694611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea07145-746c-4574-915a-6db53074beda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.699965 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aba11-7ce2-4eef-b87d-5dfc1e7977e0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.706092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea07145-746c-4574-915a-6db53074beda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-4ea07145-746c-4574-915a-6db53074beda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:30.711451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:30.714386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 389/779] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:30.715460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea07145-746c-4574-915a-6db53074beda None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.732831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.742826 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907cd01-1ae8-48d4-ba0f-cd7b9833efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.748391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907cd01-1ae8-48d4-ba0f-cd7b9833efed None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.748391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907cd01-1ae8-48d4-ba0f-cd7b9833efed None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.748391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907cd01-1ae8-48d4-ba0f-cd7b9833efed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.748391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907cd01-1ae8-48d4-ba0f-cd7b9833efed None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=656ce4b09cf6425193b7e58562ccaced) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:30.748391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907cd01-1ae8-48d4-ba0f-cd7b9833efed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.748391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907cd01-1ae8-48d4-ba0f-cd7b9833efed None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.758937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 391/780] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/role_assignments?user.id=656ce4b09cf6425193b7e58562ccaced&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:30.758937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830dffd-bfff-45f9-b8fd-e5f81b6546d4 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.758937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830dffd-bfff-45f9-b8fd-e5f81b6546d4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.758937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830dffd-bfff-45f9-b8fd-e5f81b6546d4 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.759586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 392/781] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:30.760555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830dffd-bfff-45f9-b8fd-e5f81b6546d4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.769177 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.849132 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea07145-746c-4574-915a-6db53074beda None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.891874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830dffd-bfff-45f9-b8fd-e5f81b6546d4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.903364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee75752-adaf-4847-9d2d-537ce8c194f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.904880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75752-adaf-4847-9d2d-537ce8c194f3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.905467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75752-adaf-4847-9d2d-537ce8c194f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.905897 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75752-adaf-4847-9d2d-537ce8c194f3 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.906989 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75752-adaf-4847-9d2d-537ce8c194f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:30.907953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75752-adaf-4847-9d2d-537ce8c194f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.909801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75752-adaf-4847-9d2d-537ce8c194f3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.917554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 390/782] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:30.919124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511353b-33c8-4ca0-a613-265668e7f9b4 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.919560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511353b-33c8-4ca0-a613-265668e7f9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.920024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511353b-33c8-4ca0-a613-265668e7f9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.935183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62453dd-5100-443d-bf35-e7f13304300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.935929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62453dd-5100-443d-bf35-e7f13304300d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.936319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62453dd-5100-443d-bf35-e7f13304300d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.936689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62453dd-5100-443d-bf35-e7f13304300d None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.937454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62453dd-5100-443d-bf35-e7f13304300d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:30.937881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62453dd-5100-443d-bf35-e7f13304300d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.939673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62453dd-5100-443d-bf35-e7f13304300d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.940043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-9511353b-33c8-4ca0-a613-265668e7f9b4 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:30.942549 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9511353b-33c8-4ca0-a613-265668e7f9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:30.951332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 393/783] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:30.952369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62453dd-5100-443d-bf35-e7f13304300d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.011115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.029264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 391/784] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:31.031317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511353b-33c8-4ca0-a613-265668e7f9b4 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.066905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62453dd-5100-443d-bf35-e7f13304300d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.106022 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.123027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9914-e92b-4d40-a68f-d707390f8d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.123652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9914-e92b-4d40-a68f-d707390f8d4c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.123933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9914-e92b-4d40-a68f-d707390f8d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.124212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9914-e92b-4d40-a68f-d707390f8d4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.124919 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f9914-e92b-4d40-a68f-d707390f8d4c None admin] RBAC: Adding query filter params (interface=public, service_id=8c400ddc21124f24951fe9bbf0bc7d91, region_id=RegionOne) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:31.125233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f9914-e92b-4d40-a68f-d707390f8d4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.126669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f9914-e92b-4d40-a68f-d707390f8d4c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.132820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 394/785] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/endpoints?service_id=8c400ddc21124f24951fe9bbf0bc7d91&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:31.139283 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9914-e92b-4d40-a68f-d707390f8d4c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.190223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511353b-33c8-4ca0-a613-265668e7f9b4 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.225067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83484c97-0b93-4f65-adea-5425bd9bd4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.225702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83484c97-0b93-4f65-adea-5425bd9bd4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.225985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83484c97-0b93-4f65-adea-5425bd9bd4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.226331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83484c97-0b93-4f65-adea-5425bd9bd4c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.248852 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83484c97-0b93-4f65-adea-5425bd9bd4c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.250359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83484c97-0b93-4f65-adea-5425bd9bd4c3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-83484c97-0b93-4f65-adea-5425bd9bd4c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:31.272117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:31.273124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:31.274709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:31.274709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:31.274709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:31.274709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 392/786] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:31.279147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83484c97-0b93-4f65-adea-5425bd9bd4c3 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.362941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9914-e92b-4d40-a68f-d707390f8d4c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.386865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.387289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.401053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83484c97-0b93-4f65-adea-5425bd9bd4c3 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.408437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288a0ec-218e-426f-a617-e38da6bba3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.409057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288a0ec-218e-426f-a617-e38da6bba3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.409342 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288a0ec-218e-426f-a617-e38da6bba3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.410218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288a0ec-218e-426f-a617-e38da6bba3a2 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.410893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288a0ec-218e-426f-a617-e38da6bba3a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.412763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288a0ec-218e-426f-a617-e38da6bba3a2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.419750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 395/787] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/services => generated 772 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:31.420571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288a0ec-218e-426f-a617-e38da6bba3a2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.447808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3927-9750-4201-b2d0-c6c0a0dcc2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.449483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3927-9750-4201-b2d0-c6c0a0dcc2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.449982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3927-9750-4201-b2d0-c6c0a0dcc2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.450494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3927-9750-4201-b2d0-c6c0a0dcc2a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.451401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3927-9750-4201-b2d0-c6c0a0dcc2a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:31.452563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3927-9750-4201-b2d0-c6c0a0dcc2a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.454780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3927-9750-4201-b2d0-c6c0a0dcc2a2 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.474063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 393/788] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:31.480976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3927-9750-4201-b2d0-c6c0a0dcc2a2 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.561738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288a0ec-218e-426f-a617-e38da6bba3a2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.600782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d5a13-cc6c-4002-a779-d31b6f361db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.601504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d5a13-cc6c-4002-a779-d31b6f361db1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.601788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d5a13-cc6c-4002-a779-d31b6f361db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.602064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d5a13-cc6c-4002-a779-d31b6f361db1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.613306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d5a13-cc6c-4002-a779-d31b6f361db1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-fd2d5a13-cc6c-4002-a779-d31b6f361db1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:31.618676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:31.619675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:31.620535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 396/789] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:31.631338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d5a13-cc6c-4002-a779-d31b6f361db1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.632175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3927-9750-4201-b2d0-c6c0a0dcc2a2 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.682907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827402b-085a-45bd-8286-437265214a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.683893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827402b-085a-45bd-8286-437265214a6b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.684361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827402b-085a-45bd-8286-437265214a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.684816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827402b-085a-45bd-8286-437265214a6b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.695999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827402b-085a-45bd-8286-437265214a6b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.697710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827402b-085a-45bd-8286-437265214a6b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.704365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-5827402b-085a-45bd-8286-437265214a6b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:31.711047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:31.712705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:31.713682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:31.713682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:31.713682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:31.713682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:31.713682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:31.713682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:31.713682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:31.713682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:31.713682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:31.713682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:31.715726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 394/790] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:31.721462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827402b-085a-45bd-8286-437265214a6b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.740089 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.767795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d5a13-cc6c-4002-a779-d31b6f361db1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.804389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb72be-c13e-4c29-84e5-b1c42e19c892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.805021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb72be-c13e-4c29-84e5-b1c42e19c892 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.805309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb72be-c13e-4c29-84e5-b1c42e19c892 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.805646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb72be-c13e-4c29-84e5-b1c42e19c892 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.806361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb72be-c13e-4c29-84e5-b1c42e19c892 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:31.806675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb72be-c13e-4c29-84e5-b1c42e19c892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.808067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb72be-c13e-4c29-84e5-b1c42e19c892 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.817586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 397/791] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:31.823724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb72be-c13e-4c29-84e5-b1c42e19c892 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.844308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827402b-085a-45bd-8286-437265214a6b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.885799 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e0ef-f840-4878-97b2-ac4bdf9a98e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.886854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e0ef-f840-4878-97b2-ac4bdf9a98e0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.887349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e0ef-f840-4878-97b2-ac4bdf9a98e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.887849 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e0ef-f840-4878-97b2-ac4bdf9a98e0 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.888979 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779e0ef-f840-4878-97b2-ac4bdf9a98e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:31.890387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779e0ef-f840-4878-97b2-ac4bdf9a98e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.892378 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779e0ef-f840-4878-97b2-ac4bdf9a98e0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.912794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 395/792] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:31.918639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e0ef-f840-4878-97b2-ac4bdf9a98e0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.951016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb72be-c13e-4c29-84e5-b1c42e19c892 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.952834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.994335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4e9f2-53dd-4bed-a4d6-37f07b3a8c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.994335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4e9f2-53dd-4bed-a4d6-37f07b3a8c74 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.994335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4e9f2-53dd-4bed-a4d6-37f07b3a8c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.994335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4e9f2-53dd-4bed-a4d6-37f07b3a8c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.008040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4e9f2-53dd-4bed-a4d6-37f07b3a8c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.010006 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4e9f2-53dd-4bed-a4d6-37f07b3a8c74 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f4d4e9f2-53dd-4bed-a4d6-37f07b3a8c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:32.027996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:32.029065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:32.029986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:32.029986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:32.029986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:32.029986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 398/793] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:32.035016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4e9f2-53dd-4bed-a4d6-37f07b3a8c74 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.054554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:32.094152 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e0ef-f840-4878-97b2-ac4bdf9a98e0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.188298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4e9f2-53dd-4bed-a4d6-37f07b3a8c74 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.212514 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0c4bb-7622-41cf-9cf5-0061d0e364d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.213140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0c4bb-7622-41cf-9cf5-0061d0e364d1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.213423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0c4bb-7622-41cf-9cf5-0061d0e364d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.213698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0c4bb-7622-41cf-9cf5-0061d0e364d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.238113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1ee8d-b093-4489-88c4-4d6dd8e3a189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.238868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1ee8d-b093-4489-88c4-4d6dd8e3a189 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.239155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1ee8d-b093-4489-88c4-4d6dd8e3a189 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.239436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1ee8d-b093-4489-88c4-4d6dd8e3a189 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.240091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1ee8d-b093-4489-88c4-4d6dd8e3a189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:32.240401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1ee8d-b093-4489-88c4-4d6dd8e3a189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.241788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1ee8d-b093-4489-88c4-4d6dd8e3a189 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.271999 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 399/794] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:32.276202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1ee8d-b093-4489-88c4-4d6dd8e3a189 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.297896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:32.336495 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0c4bb-7622-41cf-9cf5-0061d0e364d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.338018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0c4bb-7622-41cf-9cf5-0061d0e364d1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.395809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1ee8d-b093-4489-88c4-4d6dd8e3a189 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.433752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0c830-3eff-4339-97af-5e8d97a0ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.434585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0c830-3eff-4339-97af-5e8d97a0ee24 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.438219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0c830-3eff-4339-97af-5e8d97a0ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.438219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0c830-3eff-4339-97af-5e8d97a0ee24 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.446222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0c830-3eff-4339-97af-5e8d97a0ee24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.446222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0c830-3eff-4339-97af-5e8d97a0ee24 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c7f0c830-3eff-4339-97af-5e8d97a0ee24 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:32.459237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:32.460578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:32.462555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 400/795] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:32.466337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28158a-4115-4a31-939e-5e874463d634 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.466337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28158a-4115-4a31-939e-5e874463d634 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.466337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28158a-4115-4a31-939e-5e874463d634 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.466337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 401/796] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:32.468299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:32.475680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28158a-4115-4a31-939e-5e874463d634 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.510600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 396/797] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:27:32.510600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048134-2485-4291-b700-71cb88679328 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.510600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048134-2485-4291-b700-71cb88679328 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.510600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048134-2485-4291-b700-71cb88679328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.533856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5b048134-2485-4291-b700-71cb88679328 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:32.535682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5b048134-2485-4291-b700-71cb88679328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:32.576199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:32.604996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28158a-4115-4a31-939e-5e874463d634 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.626221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 397/798] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:32.626221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048134-2485-4291-b700-71cb88679328 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.669706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2f608-c654-4d93-bdfc-5c8b876d5112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.670798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f608-c654-4d93-bdfc-5c8b876d5112 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.671293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f608-c654-4d93-bdfc-5c8b876d5112 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.671800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f608-c654-4d93-bdfc-5c8b876d5112 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.672910 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2f608-c654-4d93-bdfc-5c8b876d5112 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:32.673478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2f608-c654-4d93-bdfc-5c8b876d5112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.675801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2f608-c654-4d93-bdfc-5c8b876d5112 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.707397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 402/799] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:32.719711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2f608-c654-4d93-bdfc-5c8b876d5112 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.732027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:32.734918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048134-2485-4291-b700-71cb88679328 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.774807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970a251-be03-4932-89a6-55dc26f6e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.775837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970a251-be03-4932-89a6-55dc26f6e757 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.776214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970a251-be03-4932-89a6-55dc26f6e757 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.776586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970a251-be03-4932-89a6-55dc26f6e757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.803314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970a251-be03-4932-89a6-55dc26f6e757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.804786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970a251-be03-4932-89a6-55dc26f6e757 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-d970a251-be03-4932-89a6-55dc26f6e757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:32.843421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:32.844571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:32.845522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:32.845522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:32.845522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:32.845522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 398/800] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:32.852402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970a251-be03-4932-89a6-55dc26f6e757 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.867994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2f608-c654-4d93-bdfc-5c8b876d5112 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.904188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:32.909904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519dad1-5c3e-4950-b889-1e1d79d91690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.910825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519dad1-5c3e-4950-b889-1e1d79d91690 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.911251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519dad1-5c3e-4950-b889-1e1d79d91690 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.911682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519dad1-5c3e-4950-b889-1e1d79d91690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.922154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519dad1-5c3e-4950-b889-1e1d79d91690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.923851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519dad1-5c3e-4950-b889-1e1d79d91690 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6519dad1-5c3e-4950-b889-1e1d79d91690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:32.940277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:32.942308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:32.943297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:32.943297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:32.943297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:32.949345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 403/801] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:32.950835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc3148-4a2e-43c1-b7c3-120abc79b9da None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.951273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc3148-4a2e-43c1-b7c3-120abc79b9da None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.951694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc3148-4a2e-43c1-b7c3-120abc79b9da None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.953607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 404/802] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:32.954588 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc3148-4a2e-43c1-b7c3-120abc79b9da None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.971436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970a251-be03-4932-89a6-55dc26f6e757 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.010460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2faa2-d5c9-4dee-80e0-acf5232d69b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.011091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2faa2-d5c9-4dee-80e0-acf5232d69b2 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.011373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2faa2-d5c9-4dee-80e0-acf5232d69b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.011648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2faa2-d5c9-4dee-80e0-acf5232d69b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.012305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2faa2-d5c9-4dee-80e0-acf5232d69b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:33.012611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2faa2-d5c9-4dee-80e0-acf5232d69b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.014033 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2faa2-d5c9-4dee-80e0-acf5232d69b2 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.033246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 399/803] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:33.033246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361de3-cadd-4077-b455-b6f8d9c31811 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.033246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361de3-cadd-4077-b455-b6f8d9c31811 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.033246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361de3-cadd-4077-b455-b6f8d9c31811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.050852 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-fd361de3-cadd-4077-b455-b6f8d9c31811 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:33.052201 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-fd361de3-cadd-4077-b455-b6f8d9c31811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:33.061512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.130672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 400/804] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:33.130672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd361de3-cadd-4077-b455-b6f8d9c31811 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.196496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc3148-4a2e-43c1-b7c3-120abc79b9da None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.237349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b98f82-4bb4-411d-bf4c-aeba28a9e15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.238883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98f82-4bb4-411d-bf4c-aeba28a9e15e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.239456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98f82-4bb4-411d-bf4c-aeba28a9e15e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.239883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98f82-4bb4-411d-bf4c-aeba28a9e15e None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.240664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b98f82-4bb4-411d-bf4c-aeba28a9e15e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:33.241153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b98f82-4bb4-411d-bf4c-aeba28a9e15e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.242832 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b98f82-4bb4-411d-bf4c-aeba28a9e15e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.257708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 405/805] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:33.259351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b98f82-4bb4-411d-bf4c-aeba28a9e15e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.271913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd361de3-cadd-4077-b455-b6f8d9c31811 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.310235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bb015-e3b9-4360-94f6-16748c3a6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.311241 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb015-e3b9-4360-94f6-16748c3a6513 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.311782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb015-e3b9-4360-94f6-16748c3a6513 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.312264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb015-e3b9-4360-94f6-16748c3a6513 None admin] PATH_INFO: `/v3/services/network` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.313046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bb015-e3b9-4360-94f6-16748c3a6513 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.314641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bb015-e3b9-4360-94f6-16748c3a6513 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-bf7bb015-e3b9-4360-94f6-16748c3a6513 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:33.324081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:33.325088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:33.325948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:33.326739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.333953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 401/806] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:33.338289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bb015-e3b9-4360-94f6-16748c3a6513 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.345359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.400996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b98f82-4bb4-411d-bf4c-aeba28a9e15e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.439998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a48869-e39b-4477-aba5-38b436cbcf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.441104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a48869-e39b-4477-aba5-38b436cbcf5c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.441409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a48869-e39b-4477-aba5-38b436cbcf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.441657 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a48869-e39b-4477-aba5-38b436cbcf5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.448435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a48869-e39b-4477-aba5-38b436cbcf5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.449561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bb015-e3b9-4360-94f6-16748c3a6513 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.449874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a48869-e39b-4477-aba5-38b436cbcf5c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-30a48869-e39b-4477-aba5-38b436cbcf5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:33.461698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:33.462823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:33.463725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:33.463725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:33.463725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:33.463725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:33.463725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:33.463725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:33.463725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:33.463725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:33.463725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 406/807] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:33.463725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a48869-e39b-4477-aba5-38b436cbcf5c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.494369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd4862-d199-46b3-8a81-4f0b1c37823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.495193 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd4862-d199-46b3-8a81-4f0b1c37823e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.495305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd4862-d199-46b3-8a81-4f0b1c37823e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.495513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd4862-d199-46b3-8a81-4f0b1c37823e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.503199 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd4862-d199-46b3-8a81-4f0b1c37823e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.505139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd4862-d199-46b3-8a81-4f0b1c37823e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-33dd4862-d199-46b3-8a81-4f0b1c37823e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:33.516856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:33.517780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:33.519675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:33.519675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:33.519675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:33.519675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:33.519675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:33.519675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:33.519675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:33.519675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:33.519675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 402/808] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:33.519675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd4862-d199-46b3-8a81-4f0b1c37823e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.579090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a48869-e39b-4477-aba5-38b436cbcf5c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.582919 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.592411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.615556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e6d7a-f520-429d-9080-64a222cf8b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.616165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e6d7a-f520-429d-9080-64a222cf8b06 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.616446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e6d7a-f520-429d-9080-64a222cf8b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.616716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e6d7a-f520-429d-9080-64a222cf8b06 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.617401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e6d7a-f520-429d-9080-64a222cf8b06 None admin] RBAC: Adding query filter params (name=network) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:33.617698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e6d7a-f520-429d-9080-64a222cf8b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.619106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e6d7a-f520-429d-9080-64a222cf8b06 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.623723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 407/809] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:33.624412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e6d7a-f520-429d-9080-64a222cf8b06 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.632938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd4862-d199-46b3-8a81-4f0b1c37823e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.668802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab30969-c07d-4988-916a-6c98f3f74620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.669439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab30969-c07d-4988-916a-6c98f3f74620 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.669725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab30969-c07d-4988-916a-6c98f3f74620 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.670004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab30969-c07d-4988-916a-6c98f3f74620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.680925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab30969-c07d-4988-916a-6c98f3f74620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-aab30969-c07d-4988-916a-6c98f3f74620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:33.686236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:33.687187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:33.688038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 403/810] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:33.688759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab30969-c07d-4988-916a-6c98f3f74620 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.737205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e6d7a-f520-429d-9080-64a222cf8b06 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.774879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b315f63-6db0-4408-b425-6405f0cf3645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.775268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b315f63-6db0-4408-b425-6405f0cf3645 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.775548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b315f63-6db0-4408-b425-6405f0cf3645 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.775818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b315f63-6db0-4408-b425-6405f0cf3645 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.776503 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b315f63-6db0-4408-b425-6405f0cf3645 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:33.776806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b315f63-6db0-4408-b425-6405f0cf3645 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.778247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b315f63-6db0-4408-b425-6405f0cf3645 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.790757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 408/811] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:33.791462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b315f63-6db0-4408-b425-6405f0cf3645 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.806811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab30969-c07d-4988-916a-6c98f3f74620 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.823595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.835968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.843151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd867771-c82f-4cc7-94e2-f42ef9938e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.843761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd867771-c82f-4cc7-94e2-f42ef9938e05 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.844051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd867771-c82f-4cc7-94e2-f42ef9938e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.844329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd867771-c82f-4cc7-94e2-f42ef9938e05 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.844991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd867771-c82f-4cc7-94e2-f42ef9938e05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:33.845292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd867771-c82f-4cc7-94e2-f42ef9938e05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.846782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd867771-c82f-4cc7-94e2-f42ef9938e05 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.859752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 404/812] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:33.860590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd867771-c82f-4cc7-94e2-f42ef9938e05 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.907520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b315f63-6db0-4408-b425-6405f0cf3645 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.944854 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ab99f-e499-40ce-a939-f52f09799524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.945568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ab99f-e499-40ce-a939-f52f09799524 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.945865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ab99f-e499-40ce-a939-f52f09799524 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.946147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ab99f-e499-40ce-a939-f52f09799524 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.946804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ab99f-e499-40ce-a939-f52f09799524 None admin] RBAC: Adding query filter params (type=network) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:33.947113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ab99f-e499-40ce-a939-f52f09799524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.948494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ab99f-e499-40ce-a939-f52f09799524 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.958148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 409/813] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:33.958148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ab99f-e499-40ce-a939-f52f09799524 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.964328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd867771-c82f-4cc7-94e2-f42ef9938e05 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.998109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64878f-1608-48aa-9fda-9d316099639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.998736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64878f-1608-48aa-9fda-9d316099639f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.999028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64878f-1608-48aa-9fda-9d316099639f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.999306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64878f-1608-48aa-9fda-9d316099639f None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.999968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64878f-1608-48aa-9fda-9d316099639f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:34.000275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64878f-1608-48aa-9fda-9d316099639f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.001631 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64878f-1608-48aa-9fda-9d316099639f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.010126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 405/814] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:34.010906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64878f-1608-48aa-9fda-9d316099639f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.046437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.055672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ab99f-e499-40ce-a939-f52f09799524 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.063718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.089782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004f8fc-7527-477f-8666-749ffb193514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.090368 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f8fc-7527-477f-8666-749ffb193514 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.090792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f8fc-7527-477f-8666-749ffb193514 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.091422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f8fc-7527-477f-8666-749ffb193514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.092151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004f8fc-7527-477f-8666-749ffb193514 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=9e2f71ebeca2441791a0241de737cad0) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:34.092463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004f8fc-7527-477f-8666-749ffb193514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.093909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004f8fc-7527-477f-8666-749ffb193514 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.099758 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 410/815] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/role_assignments?user.id=9e2f71ebeca2441791a0241de737cad0&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:34.101193 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64fd37-0ff9-4ddb-b14a-831344e59716 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.101584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64fd37-0ff9-4ddb-b14a-831344e59716 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.101990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64fd37-0ff9-4ddb-b14a-831344e59716 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.103544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 411/816] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:34.104239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64fd37-0ff9-4ddb-b14a-831344e59716 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.116254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64878f-1608-48aa-9fda-9d316099639f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.156860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17354484-2391-4a9a-ad6f-5e32b2ad841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.157555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17354484-2391-4a9a-ad6f-5e32b2ad841b None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.157843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17354484-2391-4a9a-ad6f-5e32b2ad841b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.158140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17354484-2391-4a9a-ad6f-5e32b2ad841b None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/be2fc683522941169708877bcfe2dc56/roles/0cef1088535b4535b2d6d5cc17c09549` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.181111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17354484-2391-4a9a-ad6f-5e32b2ad841b None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=be2fc683522941169708877bcfe2dc56, role_id=0cef1088535b4535b2d6d5cc17c09549)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.183004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17354484-2391-4a9a-ad6f-5e32b2ad841b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.236813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64fd37-0ff9-4ddb-b14a-831344e59716 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.274008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c6806-fead-468a-a9c9-ee45f9502a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.274247 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 406/817] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:34 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/be2fc683522941169708877bcfe2dc56/roles/0cef1088535b4535b2d6d5cc17c09549 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:34.274687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6806-fead-468a-a9c9-ee45f9502a77 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.274971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6806-fead-468a-a9c9-ee45f9502a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.275190 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17354484-2391-4a9a-ad6f-5e32b2ad841b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.275285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6806-fead-468a-a9c9-ee45f9502a77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.275893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c6806-fead-468a-a9c9-ee45f9502a77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.277288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c6806-fead-468a-a9c9-ee45f9502a77 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.364069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 412/818] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:34.364946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b05c3d-e7e8-4dca-9a9d-6516e933360f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.370220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b05c3d-e7e8-4dca-9a9d-6516e933360f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.370220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b05c3d-e7e8-4dca-9a9d-6516e933360f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.392711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-39b05c3d-e7e8-4dca-9a9d-6516e933360f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:34.394873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-39b05c3d-e7e8-4dca-9a9d-6516e933360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:34.406800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.409212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.412968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17354484-2391-4a9a-ad6f-5e32b2ad841b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.474165 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983135ae-cf55-4df1-9fda-83f7644c7f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.475094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983135ae-cf55-4df1-9fda-83f7644c7f45 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.475675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983135ae-cf55-4df1-9fda-83f7644c7f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.476106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983135ae-cf55-4df1-9fda-83f7644c7f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.489707 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983135ae-cf55-4df1-9fda-83f7644c7f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.491528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983135ae-cf55-4df1-9fda-83f7644c7f45 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.506562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 413/819] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-983135ae-cf55-4df1-9fda-83f7644c7f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:34.515630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:34.517742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:34.518959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:34.518959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:34.518959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:34.518959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 407/820] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:34.523200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b05c3d-e7e8-4dca-9a9d-6516e933360f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.636544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b05c3d-e7e8-4dca-9a9d-6516e933360f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.672278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6130af6-c419-462a-966c-a0e87c21a366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.672891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6130af6-c419-462a-966c-a0e87c21a366 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.673172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6130af6-c419-462a-966c-a0e87c21a366 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.673445 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6130af6-c419-462a-966c-a0e87c21a366 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.674083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6130af6-c419-462a-966c-a0e87c21a366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:34.674426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6130af6-c419-462a-966c-a0e87c21a366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.676311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6130af6-c419-462a-966c-a0e87c21a366 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.688158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 414/821] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:34.694298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983135ae-cf55-4df1-9fda-83f7644c7f45 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.815982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983135ae-cf55-4df1-9fda-83f7644c7f45 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.822078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6130af6-c419-462a-966c-a0e87c21a366 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.824979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.862289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e35434-7d8a-424d-923f-2844d2af8b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.863566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e35434-7d8a-424d-923f-2844d2af8b21 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.863849 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e35434-7d8a-424d-923f-2844d2af8b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.864379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e35434-7d8a-424d-923f-2844d2af8b21 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.875318 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e35434-7d8a-424d-923f-2844d2af8b21 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.876778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e35434-7d8a-424d-923f-2844d2af8b21 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-96e35434-7d8a-424d-923f-2844d2af8b21 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:34.890586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:34.891758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:34.892731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:34.892731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:34.892731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:34.892731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:34.892731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:34.892731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:34.892731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:34.892731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:34.892731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:34.892731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:34.895687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 408/822] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:34.902114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e35434-7d8a-424d-923f-2844d2af8b21 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.914364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.965640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6130af6-c419-462a-966c-a0e87c21a366 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.009842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97f87c-3895-44e3-85a3-3dd37e2cfb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.011235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97f87c-3895-44e3-85a3-3dd37e2cfb9b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.011636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97f87c-3895-44e3-85a3-3dd37e2cfb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.011919 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97f87c-3895-44e3-85a3-3dd37e2cfb9b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.012745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97f87c-3895-44e3-85a3-3dd37e2cfb9b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.014806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97f87c-3895-44e3-85a3-3dd37e2cfb9b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.016443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e35434-7d8a-424d-923f-2844d2af8b21 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-0c97f87c-3895-44e3-85a3-3dd37e2cfb9b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:35.025843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:35.027143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:35.028209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:35.034216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 415/823] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:35.034216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97f87c-3895-44e3-85a3-3dd37e2cfb9b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.060763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ce723-fd02-4154-b12b-41bf71844612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.061523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ce723-fd02-4154-b12b-41bf71844612 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.061902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ce723-fd02-4154-b12b-41bf71844612 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.062301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ce723-fd02-4154-b12b-41bf71844612 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.063125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ce723-fd02-4154-b12b-41bf71844612 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:35.063524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ce723-fd02-4154-b12b-41bf71844612 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.065043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ce723-fd02-4154-b12b-41bf71844612 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.089067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 409/824] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:35.090265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ce723-fd02-4154-b12b-41bf71844612 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.118254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.152859 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97f87c-3895-44e3-85a3-3dd37e2cfb9b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.168054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.199971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad141553-6d75-4678-b614-04e2b5004a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.200729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad141553-6d75-4678-b614-04e2b5004a7c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.201273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad141553-6d75-4678-b614-04e2b5004a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.201464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad141553-6d75-4678-b614-04e2b5004a7c None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.202323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad141553-6d75-4678-b614-04e2b5004a7c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:35.202733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad141553-6d75-4678-b614-04e2b5004a7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.204203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad141553-6d75-4678-b614-04e2b5004a7c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.214145 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 416/825] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:35.214318 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ce723-fd02-4154-b12b-41bf71844612 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.215543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad141553-6d75-4678-b614-04e2b5004a7c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.257767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281bd8-b8e4-4e0b-b4ac-c9d90657cca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.258452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281bd8-b8e4-4e0b-b4ac-c9d90657cca6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.258737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281bd8-b8e4-4e0b-b4ac-c9d90657cca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.259007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281bd8-b8e4-4e0b-b4ac-c9d90657cca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.271622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b281bd8-b8e4-4e0b-b4ac-c9d90657cca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.273687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b281bd8-b8e4-4e0b-b4ac-c9d90657cca6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-7b281bd8-b8e4-4e0b-b4ac-c9d90657cca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:35.292998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:35.294006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:35.294963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:35.294963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:35.294963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:35.298270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 410/826] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:35.299698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281bd8-b8e4-4e0b-b4ac-c9d90657cca6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.354916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad141553-6d75-4678-b614-04e2b5004a7c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.390864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.398232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb75370-9ac1-4712-bd43-116024012798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.398820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75370-9ac1-4712-bd43-116024012798 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.399101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75370-9ac1-4712-bd43-116024012798 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.405151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75370-9ac1-4712-bd43-116024012798 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.405151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb75370-9ac1-4712-bd43-116024012798 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:35.405151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb75370-9ac1-4712-bd43-116024012798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.405151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb75370-9ac1-4712-bd43-116024012798 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.413380 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 417/827] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:35.414314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb75370-9ac1-4712-bd43-116024012798 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.424917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281bd8-b8e4-4e0b-b4ac-c9d90657cca6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.444498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.464590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6863d4-2287-418a-b19a-da6162e69f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.465588 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6863d4-2287-418a-b19a-da6162e69f75 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.466160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6863d4-2287-418a-b19a-da6162e69f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.466639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6863d4-2287-418a-b19a-da6162e69f75 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.467481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6863d4-2287-418a-b19a-da6162e69f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:35.467984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6863d4-2287-418a-b19a-da6162e69f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.469651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6863d4-2287-418a-b19a-da6162e69f75 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.483285 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 411/828] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:35.490632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6863d4-2287-418a-b19a-da6162e69f75 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.529938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb75370-9ac1-4712-bd43-116024012798 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.567731 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75932984-d224-4240-8359-ca7a9c50d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.568555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75932984-d224-4240-8359-ca7a9c50d728 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.568689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75932984-d224-4240-8359-ca7a9c50d728 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.568906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75932984-d224-4240-8359-ca7a9c50d728 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.569556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75932984-d224-4240-8359-ca7a9c50d728 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.570970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75932984-d224-4240-8359-ca7a9c50d728 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.606436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6863d4-2287-418a-b19a-da6162e69f75 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.643319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705c82d-c6bb-4014-b6a7-b76aa432b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.645240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705c82d-c6bb-4014-b6a7-b76aa432b9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.645662 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705c82d-c6bb-4014-b6a7-b76aa432b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.646080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705c82d-c6bb-4014-b6a7-b76aa432b9c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.654355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 418/829] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:35.661151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705c82d-c6bb-4014-b6a7-b76aa432b9c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.662926 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705c82d-c6bb-4014-b6a7-b76aa432b9c6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-7705c82d-c6bb-4014-b6a7-b76aa432b9c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:35.678315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:35.679594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:35.680723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:35.680723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:35.680723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:35.680723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:35.680723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:35.680723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:35.680723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:35.680723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:35.682989 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 412/830] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:35.688547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75932984-d224-4240-8359-ca7a9c50d728 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.753131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.816759 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75932984-d224-4240-8359-ca7a9c50d728 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.854074 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816b0bb-9282-4eaa-9fab-9e2010c16a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.854723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b0bb-9282-4eaa-9fab-9e2010c16a6c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.855002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b0bb-9282-4eaa-9fab-9e2010c16a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.855275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b0bb-9282-4eaa-9fab-9e2010c16a6c None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.855967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816b0bb-9282-4eaa-9fab-9e2010c16a6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:35.856272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816b0bb-9282-4eaa-9fab-9e2010c16a6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.857702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816b0bb-9282-4eaa-9fab-9e2010c16a6c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.874765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 419/831] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:35.876597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705c82d-c6bb-4014-b6a7-b76aa432b9c6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.916658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.106119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705c82d-c6bb-4014-b6a7-b76aa432b9c6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.142063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe8e9b-020f-43eb-a511-6f90b19aed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.143053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe8e9b-020f-43eb-a511-6f90b19aed11 None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.143510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe8e9b-020f-43eb-a511-6f90b19aed11 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.144270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe8e9b-020f-43eb-a511-6f90b19aed11 None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/656ce4b09cf6425193b7e58562ccaced/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.146573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe8e9b-020f-43eb-a511-6f90b19aed11 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=656ce4b09cf6425193b7e58562ccaced, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.148204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe8e9b-020f-43eb-a511-6f90b19aed11 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.231124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 413/832] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:35 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/656ce4b09cf6425193b7e58562ccaced/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:36.288109 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc72ec-586d-4e6d-9c42-9783c2672d15 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.288446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc72ec-586d-4e6d-9c42-9783c2672d15 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.288684 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc72ec-586d-4e6d-9c42-9783c2672d15 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.290403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 420/833] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:36.296174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8737-d130-4645-a789-3b7ce2d20fcd None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.296462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8737-d130-4645-a789-3b7ce2d20fcd None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.296737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8737-d130-4645-a789-3b7ce2d20fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.318454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-17ba8737-d130-4645-a789-3b7ce2d20fcd None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:36.319646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-17ba8737-d130-4645-a789-3b7ce2d20fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:36.377408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e099db-d255-4626-bd18-858d4710ea80 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.377744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e099db-d255-4626-bd18-858d4710ea80 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.378021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e099db-d255-4626-bd18-858d4710ea80 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.381003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 421/834] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:36.385524 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451d7bb-29d5-4dfb-9144-efb87fe6cf8f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.385813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451d7bb-29d5-4dfb-9144-efb87fe6cf8f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.386130 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451d7bb-29d5-4dfb-9144-efb87fe6cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.396086 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 414/835] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:36.406219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b451d7bb-29d5-4dfb-9144-efb87fe6cf8f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:36.407446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b451d7bb-29d5-4dfb-9144-efb87fe6cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:36.486405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 422/836] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:36.670668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8737-d130-4645-a789-3b7ce2d20fcd None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.698815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.756617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451d7bb-29d5-4dfb-9144-efb87fe6cf8f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.780944 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8737-d130-4645-a789-3b7ce2d20fcd None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.792631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.818740 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62abf2e-e91a-4e10-a098-c43a3009a54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.819614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62abf2e-e91a-4e10-a098-c43a3009a54e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.820039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62abf2e-e91a-4e10-a098-c43a3009a54e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.820475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62abf2e-e91a-4e10-a098-c43a3009a54e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.821202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62abf2e-e91a-4e10-a098-c43a3009a54e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.822745 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62abf2e-e91a-4e10-a098-c43a3009a54e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-d62abf2e-e91a-4e10-a098-c43a3009a54e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:36.833417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:36.834634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:36.835758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:36.838149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 415/837] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:36.851507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62abf2e-e91a-4e10-a098-c43a3009a54e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.870440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451d7bb-29d5-4dfb-9144-efb87fe6cf8f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.911430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903728-0f75-4edc-be67-58f298093476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.912470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903728-0f75-4edc-be67-58f298093476 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.913028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903728-0f75-4edc-be67-58f298093476 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.913507 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903728-0f75-4edc-be67-58f298093476 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.924992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d903728-0f75-4edc-be67-58f298093476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-8d903728-0f75-4edc-be67-58f298093476 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:36.930453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:36.931388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:36.932281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:36.938366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 423/838] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:36.942336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903728-0f75-4edc-be67-58f298093476 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.952128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.962293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62abf2e-e91a-4e10-a098-c43a3009a54e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.999611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0a97-0654-4ed3-8987-e58426367d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.000218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0a97-0654-4ed3-8987-e58426367d0c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.000505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0a97-0654-4ed3-8987-e58426367d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.000784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0a97-0654-4ed3-8987-e58426367d0c None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.001478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b0a97-0654-4ed3-8987-e58426367d0c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:37.001846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b0a97-0654-4ed3-8987-e58426367d0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.003513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b0a97-0654-4ed3-8987-e58426367d0c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.013345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 416/839] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:37.014151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0a97-0654-4ed3-8987-e58426367d0c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.049346 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:37.056252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903728-0f75-4edc-be67-58f298093476 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.093552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5f726-ef67-4120-b197-4ed3ff3ea9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.094352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5f726-ef67-4120-b197-4ed3ff3ea9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.094740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5f726-ef67-4120-b197-4ed3ff3ea9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.095115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5f726-ef67-4120-b197-4ed3ff3ea9e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.096006 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5f726-ef67-4120-b197-4ed3ff3ea9e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:37.096495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5f726-ef67-4120-b197-4ed3ff3ea9e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.098269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5f726-ef67-4120-b197-4ed3ff3ea9e9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.111973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 424/840] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:37.113788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5f726-ef67-4120-b197-4ed3ff3ea9e9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.123974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0a97-0654-4ed3-8987-e58426367d0c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.162447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8188d5-29f6-4cea-86fe-528d9922e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.163304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8188d5-29f6-4cea-86fe-528d9922e409 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.163763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8188d5-29f6-4cea-86fe-528d9922e409 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.164202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8188d5-29f6-4cea-86fe-528d9922e409 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.165132 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8188d5-29f6-4cea-86fe-528d9922e409 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:37.165688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8188d5-29f6-4cea-86fe-528d9922e409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.167372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8188d5-29f6-4cea-86fe-528d9922e409 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.172466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 417/841] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:37.228642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5f726-ef67-4120-b197-4ed3ff3ea9e9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.268356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cfb56-806b-483d-a210-dd13eecd61ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.269634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cfb56-806b-483d-a210-dd13eecd61ff None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.269923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cfb56-806b-483d-a210-dd13eecd61ff None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.270218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cfb56-806b-483d-a210-dd13eecd61ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.282526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cfb56-806b-483d-a210-dd13eecd61ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.284027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cfb56-806b-483d-a210-dd13eecd61ff None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-033cfb56-806b-483d-a210-dd13eecd61ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:37.301071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:37.302131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:37.303069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:37.303069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:37.303069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:37.306397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 425/842] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:37.308786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8188d5-29f6-4cea-86fe-528d9922e409 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.332082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:37.422346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8188d5-29f6-4cea-86fe-528d9922e409 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.460208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8569f1-f855-42eb-becd-d8f02753f259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.461216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8569f1-f855-42eb-becd-d8f02753f259 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.461712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8569f1-f855-42eb-becd-d8f02753f259 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.462219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8569f1-f855-42eb-becd-d8f02753f259 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.463075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8569f1-f855-42eb-becd-d8f02753f259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:37.463604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8569f1-f855-42eb-becd-d8f02753f259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.465207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8569f1-f855-42eb-becd-d8f02753f259 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.477885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 418/843] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:37.483195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cfb56-806b-483d-a210-dd13eecd61ff None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.496381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:37.587389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cfb56-806b-483d-a210-dd13eecd61ff None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.622221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0245c-cebd-4ddc-9df2-27a97465ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.622869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0245c-cebd-4ddc-9df2-27a97465ac1c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.623150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0245c-cebd-4ddc-9df2-27a97465ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.623426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0245c-cebd-4ddc-9df2-27a97465ac1c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.631710 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0245c-cebd-4ddc-9df2-27a97465ac1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.633170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0245c-cebd-4ddc-9df2-27a97465ac1c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-7aa0245c-cebd-4ddc-9df2-27a97465ac1c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:37.644870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:37.645884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:37.646879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:37.646879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:37.646879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:37.646879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:37.646879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:37.646879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:37.646879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:37.646879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:37.646879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:37.646879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:37.650337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 426/844] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:37.655275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8569f1-f855-42eb-becd-d8f02753f259 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.743652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:37.752067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a87af-6622-4a95-9384-030ee5a926c8 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.752546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a87af-6622-4a95-9384-030ee5a926c8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.753094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a87af-6622-4a95-9384-030ee5a926c8 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.755849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 427/845] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:37.760102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f88a-34f7-4d6a-80b3-84d52b2095d4 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.760560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f88a-34f7-4d6a-80b3-84d52b2095d4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.760985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f88a-34f7-4d6a-80b3-84d52b2095d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.766512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8569f1-f855-42eb-becd-d8f02753f259 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.780283 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-55b5f88a-34f7-4d6a-80b3-84d52b2095d4 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:37.781687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-55b5f88a-34f7-4d6a-80b3-84d52b2095d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:37.804240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5a8b1-8b43-41e0-b5f1-0d246b6d131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.804958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5a8b1-8b43-41e0-b5f1-0d246b6d131e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.805314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5a8b1-8b43-41e0-b5f1-0d246b6d131e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.805664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5a8b1-8b43-41e0-b5f1-0d246b6d131e None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.806503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5a8b1-8b43-41e0-b5f1-0d246b6d131e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:37.806887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5a8b1-8b43-41e0-b5f1-0d246b6d131e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.808451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5a8b1-8b43-41e0-b5f1-0d246b6d131e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.831699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 419/846] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:37.833118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5a8b1-8b43-41e0-b5f1-0d246b6d131e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.866745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:37.870342 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 428/847] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:37.938969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5a8b1-8b43-41e0-b5f1-0d246b6d131e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.976172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ccab3-2f48-4a68-9da5-831f3f578296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.976950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ccab3-2f48-4a68-9da5-831f3f578296 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.977326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ccab3-2f48-4a68-9da5-831f3f578296 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.977698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ccab3-2f48-4a68-9da5-831f3f578296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.981303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.049402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ccab3-2f48-4a68-9da5-831f3f578296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.051609 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ccab3-2f48-4a68-9da5-831f3f578296 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.148729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f88a-34f7-4d6a-80b3-84d52b2095d4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.157390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 420/848] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:27:38.163583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ccab3-2f48-4a68-9da5-831f3f578296 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.201882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.272689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ccab3-2f48-4a68-9da5-831f3f578296 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.281859 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f88a-34f7-4d6a-80b3-84d52b2095d4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.307845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85a3dd-b3b2-41ac-b169-a680c30f4122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.308477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85a3dd-b3b2-41ac-b169-a680c30f4122 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.308760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85a3dd-b3b2-41ac-b169-a680c30f4122 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.309032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85a3dd-b3b2-41ac-b169-a680c30f4122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.318970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece75bc-034b-4390-b910-b3c5e8ffc272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.319812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece75bc-034b-4390-b910-b3c5e8ffc272 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.320241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece75bc-034b-4390-b910-b3c5e8ffc272 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.320355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85a3dd-b3b2-41ac-b169-a680c30f4122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.320760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece75bc-034b-4390-b910-b3c5e8ffc272 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.321506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece75bc-034b-4390-b910-b3c5e8ffc272 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.321971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85a3dd-b3b2-41ac-b169-a680c30f4122 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.323385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece75bc-034b-4390-b910-b3c5e8ffc272 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6ece75bc-034b-4390-b910-b3c5e8ffc272 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:38.333399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:38.334751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:38.335797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-ae85a3dd-b3b2-41ac-b169-a680c30f4122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:38.337726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:38.338762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:38.343207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:38.343207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:38.343207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:38.343207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 421/850] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:38.343442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 429/850] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:38.343527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedb6b8-7998-405b-b54d-2ef7e98d83fc None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.343527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedb6b8-7998-405b-b54d-2ef7e98d83fc None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.343527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedb6b8-7998-405b-b54d-2ef7e98d83fc None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.345025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece75bc-034b-4390-b910-b3c5e8ffc272 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.346804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 422/851] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:38.348195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5a71-b4ab-4bc0-9bcb-d1225946685a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.348478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5a71-b4ab-4bc0-9bcb-d1225946685a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.348757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5a71-b4ab-4bc0-9bcb-d1225946685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.367132 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-371f5a71-b4ab-4bc0-9bcb-d1225946685a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:38.368315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-371f5a71-b4ab-4bc0-9bcb-d1225946685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:38.416563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.437817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 423/852] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:38.438753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f5a71-b4ab-4bc0-9bcb-d1225946685a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.461292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.465674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece75bc-034b-4390-b910-b3c5e8ffc272 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.503625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca220-e195-4631-8767-3e0d0dbad947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.505346 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca220-e195-4631-8767-3e0d0dbad947 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.505850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca220-e195-4631-8767-3e0d0dbad947 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.506436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca220-e195-4631-8767-3e0d0dbad947 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.507383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca220-e195-4631-8767-3e0d0dbad947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:38.507941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca220-e195-4631-8767-3e0d0dbad947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.513631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca220-e195-4631-8767-3e0d0dbad947 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.529068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 430/853] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:38.530764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca220-e195-4631-8767-3e0d0dbad947 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.563775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f5a71-b4ab-4bc0-9bcb-d1225946685a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.608131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f5c8-6295-4eb2-8a65-17dfbed551dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.608806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f5c8-6295-4eb2-8a65-17dfbed551dc None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.609102 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f5c8-6295-4eb2-8a65-17dfbed551dc None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.609537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f5c8-6295-4eb2-8a65-17dfbed551dc None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.610181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3f5c8-6295-4eb2-8a65-17dfbed551dc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:38.610510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3f5c8-6295-4eb2-8a65-17dfbed551dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.612724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3f5c8-6295-4eb2-8a65-17dfbed551dc None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.618226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 424/854] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:38.623800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f5c8-6295-4eb2-8a65-17dfbed551dc None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.649705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca220-e195-4631-8767-3e0d0dbad947 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.675166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.686045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022969-5a99-498a-af99-480f1f47fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.686716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022969-5a99-498a-af99-480f1f47fcaf None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.687003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022969-5a99-498a-af99-480f1f47fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.687281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022969-5a99-498a-af99-480f1f47fcaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.694544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84022969-5a99-498a-af99-480f1f47fcaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.696025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84022969-5a99-498a-af99-480f1f47fcaf None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-84022969-5a99-498a-af99-480f1f47fcaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:38.708749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:38.709696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:38.716051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:38.716051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:38.716051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:38.716051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:38.716051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:38.716051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:38.716051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:38.716051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:38.716051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 431/855] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:38.718993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022969-5a99-498a-af99-480f1f47fcaf None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.735702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.755413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f5c8-6295-4eb2-8a65-17dfbed551dc None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.795628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26755fcc-244b-48e8-8ab8-cb658dce6114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.796242 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26755fcc-244b-48e8-8ab8-cb658dce6114 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.796523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26755fcc-244b-48e8-8ab8-cb658dce6114 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.796798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26755fcc-244b-48e8-8ab8-cb658dce6114 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.797426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26755fcc-244b-48e8-8ab8-cb658dce6114 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:38.797731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26755fcc-244b-48e8-8ab8-cb658dce6114 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.799130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26755fcc-244b-48e8-8ab8-cb658dce6114 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.814223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 425/856] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:38.814223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26755fcc-244b-48e8-8ab8-cb658dce6114 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.848724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022969-5a99-498a-af99-480f1f47fcaf None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.893082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3751676-2c1e-4f01-a0b7-33beaa9ef0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.893960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751676-2c1e-4f01-a0b7-33beaa9ef0ee None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.894355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751676-2c1e-4f01-a0b7-33beaa9ef0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.894624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751676-2c1e-4f01-a0b7-33beaa9ef0ee None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.895444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3751676-2c1e-4f01-a0b7-33beaa9ef0ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:38.895828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3751676-2c1e-4f01-a0b7-33beaa9ef0ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.897397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3751676-2c1e-4f01-a0b7-33beaa9ef0ee None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.913007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 432/857] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:38.922149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3751676-2c1e-4f01-a0b7-33beaa9ef0ee None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.942524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26755fcc-244b-48e8-8ab8-cb658dce6114 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.980774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea4832-01b9-4842-a4a1-345260009502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.981764 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea4832-01b9-4842-a4a1-345260009502 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.982287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea4832-01b9-4842-a4a1-345260009502 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.982748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea4832-01b9-4842-a4a1-345260009502 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.985502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.994284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea4832-01b9-4842-a4a1-345260009502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-97ea4832-01b9-4842-a4a1-345260009502 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:38.999393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:39.000322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:39.001187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 426/858] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:39.008007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea4832-01b9-4842-a4a1-345260009502 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.018546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.057466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3751676-2c1e-4f01-a0b7-33beaa9ef0ee None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.103143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d654f-3b07-427d-9553-d0f5db687b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.103752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d654f-3b07-427d-9553-d0f5db687b88 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.104030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d654f-3b07-427d-9553-d0f5db687b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.104300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d654f-3b07-427d-9553-d0f5db687b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.105021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d654f-3b07-427d-9553-d0f5db687b88 None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=be2fc683522941169708877bcfe2dc56) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:39.105329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d654f-3b07-427d-9553-d0f5db687b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.106802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d654f-3b07-427d-9553-d0f5db687b88 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.118324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 433/859] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/role_assignments?user.id=be2fc683522941169708877bcfe2dc56&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:39.138259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea4832-01b9-4842-a4a1-345260009502 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.181231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fadd8-d279-4c8b-a313-f8f5545808ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.182171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fadd8-d279-4c8b-a313-f8f5545808ce None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.182659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fadd8-d279-4c8b-a313-f8f5545808ce None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.183257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fadd8-d279-4c8b-a313-f8f5545808ce None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.184136 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fadd8-d279-4c8b-a313-f8f5545808ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:39.184656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fadd8-d279-4c8b-a313-f8f5545808ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.186354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fadd8-d279-4c8b-a313-f8f5545808ce None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.196234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0779c7e-563e-4c76-a653-7041d93a180c None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.196483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0779c7e-563e-4c76-a653-7041d93a180c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.196714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0779c7e-563e-4c76-a653-7041d93a180c None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.198059 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 434/860] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:39.198799 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 427/861] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:39.204101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf1c6-b3c9-4f30-8907-59406e85f67b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.204384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf1c6-b3c9-4f30-8907-59406e85f67b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.204587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fadd8-d279-4c8b-a313-f8f5545808ce None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.204717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf1c6-b3c9-4f30-8907-59406e85f67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.224811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-720bf1c6-b3c9-4f30-8907-59406e85f67b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:39.226229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-720bf1c6-b3c9-4f30-8907-59406e85f67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:39.292162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.317738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 435/862] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:39.340914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fadd8-d279-4c8b-a313-f8f5545808ce None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.376167 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27296e5e-6801-437d-ab69-199335f91263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.376828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27296e5e-6801-437d-ab69-199335f91263 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.377101 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27296e5e-6801-437d-ab69-199335f91263 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.377369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27296e5e-6801-437d-ab69-199335f91263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.388388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27296e5e-6801-437d-ab69-199335f91263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.389843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27296e5e-6801-437d-ab69-199335f91263 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-27296e5e-6801-437d-ab69-199335f91263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:39.405806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:39.406858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:39.407845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:39.407845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:39.407845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:39.407845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 428/863] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:39.412834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf1c6-b3c9-4f30-8907-59406e85f67b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.456517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.521152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf1c6-b3c9-4f30-8907-59406e85f67b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.556439 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a53310-c443-4c61-be6b-06e1f6963869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.557067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a53310-c443-4c61-be6b-06e1f6963869 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.557356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a53310-c443-4c61-be6b-06e1f6963869 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.557638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a53310-c443-4c61-be6b-06e1f6963869 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.558311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a53310-c443-4c61-be6b-06e1f6963869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:39.558631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a53310-c443-4c61-be6b-06e1f6963869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.560219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a53310-c443-4c61-be6b-06e1f6963869 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.572961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 436/864] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:39.578223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27296e5e-6801-437d-ab69-199335f91263 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.612474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a53310-c443-4c61-be6b-06e1f6963869 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.704617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27296e5e-6801-437d-ab69-199335f91263 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.729491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.733228 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.734462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a53310-c443-4c61-be6b-06e1f6963869 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.753754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e01742-b8b3-4354-b654-a149ed639fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.754341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e01742-b8b3-4354-b654-a149ed639fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.754623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e01742-b8b3-4354-b654-a149ed639fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.754896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e01742-b8b3-4354-b654-a149ed639fe3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.762819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e01742-b8b3-4354-b654-a149ed639fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.765151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e01742-b8b3-4354-b654-a149ed639fe3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.776866 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a146-5d5b-4bb7-9f2f-38c5cd5dd5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.777810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a146-5d5b-4bb7-9f2f-38c5cd5dd5b2 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-63e01742-b8b3-4354-b654-a149ed639fe3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:39.777919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:39.778888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:39.780256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 429/865] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:39.781355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a146-5d5b-4bb7-9f2f-38c5cd5dd5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.781642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a146-5d5b-4bb7-9f2f-38c5cd5dd5b2 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.785600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088a146-5d5b-4bb7-9f2f-38c5cd5dd5b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.785600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088a146-5d5b-4bb7-9f2f-38c5cd5dd5b2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.785820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e01742-b8b3-4354-b654-a149ed639fe3 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.858296 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 437/866] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:39 2022] POST /identity/v3/services => generated 269 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:27:39.904836 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e01742-b8b3-4354-b654-a149ed639fe3 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.951179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e713e1-d298-457d-9869-5137ff0a2815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.952172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e713e1-d298-457d-9869-5137ff0a2815 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.952637 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e713e1-d298-457d-9869-5137ff0a2815 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.953116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e713e1-d298-457d-9869-5137ff0a2815 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.954064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e713e1-d298-457d-9869-5137ff0a2815 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:39.954603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e713e1-d298-457d-9869-5137ff0a2815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.956476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e713e1-d298-457d-9869-5137ff0a2815 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.977181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 430/867] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:39.983441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a146-5d5b-4bb7-9f2f-38c5cd5dd5b2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:40.094747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a146-5d5b-4bb7-9f2f-38c5cd5dd5b2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:40.129885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04f0d8-e816-42e8-90e4-996d9fa661c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:40.130798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04f0d8-e816-42e8-90e4-996d9fa661c9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.131232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04f0d8-e816-42e8-90e4-996d9fa661c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.131656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04f0d8-e816-42e8-90e4-996d9fa661c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.159628 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:40.209164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04f0d8-e816-42e8-90e4-996d9fa661c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:40.210721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04f0d8-e816-42e8-90e4-996d9fa661c9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:40.321769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 438/868] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:27:40.327472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e713e1-d298-457d-9869-5137ff0a2815 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:40.364777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:40.444162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e713e1-d298-457d-9869-5137ff0a2815 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:40.479948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1300f2-7fb1-46c7-8ac2-234356034050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:40.480580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1300f2-7fb1-46c7-8ac2-234356034050 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.480860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1300f2-7fb1-46c7-8ac2-234356034050 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.481133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1300f2-7fb1-46c7-8ac2-234356034050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.491852 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1300f2-7fb1-46c7-8ac2-234356034050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:40.493302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1300f2-7fb1-46c7-8ac2-234356034050 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-5f1300f2-7fb1-46c7-8ac2-234356034050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:40.508606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:40.509598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:40.510543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:40.510543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:40.510543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:40.510543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 431/869] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:40.516885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04f0d8-e816-42e8-90e4-996d9fa661c9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:40.579230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:40.627142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04f0d8-e816-42e8-90e4-996d9fa661c9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:40.665963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39fc5d-6d6f-46eb-ae78-2580de746d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:40.666976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39fc5d-6d6f-46eb-ae78-2580de746d38 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.667558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39fc5d-6d6f-46eb-ae78-2580de746d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.668036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39fc5d-6d6f-46eb-ae78-2580de746d38 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.668869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39fc5d-6d6f-46eb-ae78-2580de746d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:40.669371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39fc5d-6d6f-46eb-ae78-2580de746d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:40.670984 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39fc5d-6d6f-46eb-ae78-2580de746d38 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:40.684031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 439/870] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:40.689522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1300f2-7fb1-46c7-8ac2-234356034050 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:40.786390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:40.801945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1300f2-7fb1-46c7-8ac2-234356034050 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:40.837122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3e283-c100-4ea9-9410-787dfacf50e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:40.837681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3e283-c100-4ea9-9410-787dfacf50e9 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.837962 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3e283-c100-4ea9-9410-787dfacf50e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.838258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3e283-c100-4ea9-9410-787dfacf50e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.845254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3e283-c100-4ea9-9410-787dfacf50e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:40.846792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3e283-c100-4ea9-9410-787dfacf50e9 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:40.857140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a80ed-4c1a-4d02-8f8a-9357b020a96d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.857475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a80ed-4c1a-4d02-8f8a-9357b020a96d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.857699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a80ed-4c1a-4d02-8f8a-9357b020a96d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.859358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 440/871] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-bdf3e283-c100-4ea9-9410-787dfacf50e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:40.861602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:40.863082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:40.863994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:40.863994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:40.863994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:40.863994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:40.863994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:40.863994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:40.863994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:40.863994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:40.863994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 432/872] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:40.868915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fad4e-91b1-4d6c-99da-53f221ea6600 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.869225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fad4e-91b1-4d6c-99da-53f221ea6600 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.869474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fad4e-91b1-4d6c-99da-53f221ea6600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.873967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3e283-c100-4ea9-9410-787dfacf50e9 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:40.895660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0a8fad4e-91b1-4d6c-99da-53f221ea6600 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:40.897626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0a8fad4e-91b1-4d6c-99da-53f221ea6600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:40.998296 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 441/873] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:40 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:41.008395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3e283-c100-4ea9-9410-787dfacf50e9 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:41.043800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7a7e1-018b-4e0d-9fd8-d1cf7ff8c3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:41.044730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7a7e1-018b-4e0d-9fd8-d1cf7ff8c3fa None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.045158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7a7e1-018b-4e0d-9fd8-d1cf7ff8c3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.045667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7a7e1-018b-4e0d-9fd8-d1cf7ff8c3fa None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.046561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7a7e1-018b-4e0d-9fd8-d1cf7ff8c3fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:41.047013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7a7e1-018b-4e0d-9fd8-d1cf7ff8c3fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:41.048585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7a7e1-018b-4e0d-9fd8-d1cf7ff8c3fa None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:41.062581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 433/874] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:41.071311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fad4e-91b1-4d6c-99da-53f221ea6600 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:41.126137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:41.186830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fad4e-91b1-4d6c-99da-53f221ea6600 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:41.215852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc913-1159-4f28-9f41-452bb9ab5a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:41.216460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc913-1159-4f28-9f41-452bb9ab5a38 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.216744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc913-1159-4f28-9f41-452bb9ab5a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.217023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc913-1159-4f28-9f41-452bb9ab5a38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.217743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc913-1159-4f28-9f41-452bb9ab5a38 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=656ce4b09cf6425193b7e58562ccaced) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:41.218053 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc913-1159-4f28-9f41-452bb9ab5a38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:41.219633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc913-1159-4f28-9f41-452bb9ab5a38 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:41.221248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14124a64-dd8e-4fe8-9147-15cd2c8b3fad None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.221532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14124a64-dd8e-4fe8-9147-15cd2c8b3fad None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.222355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14124a64-dd8e-4fe8-9147-15cd2c8b3fad None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.224034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 434/875] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:41.229126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cc9b-3411-4182-bfb9-80f65faf9776 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.229674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cc9b-3411-4182-bfb9-80f65faf9776 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.230066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 442/876] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:41 2022] GET /identity/v3/role_assignments?user.id=656ce4b09cf6425193b7e58562ccaced&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:41.230434 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cc9b-3411-4182-bfb9-80f65faf9776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.246775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:41.254009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6fb3cc9b-3411-4182-bfb9-80f65faf9776 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:41.257424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6fb3cc9b-3411-4182-bfb9-80f65faf9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:41.296253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc913-1159-4f28-9f41-452bb9ab5a38 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:41.342289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 435/877] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:41 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:41.420100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc913-1159-4f28-9f41-452bb9ab5a38 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:41.434731 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:41.456724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96a654-34c4-42d8-a044-13a40709c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:41.457424 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a654-34c4-42d8-a044-13a40709c573 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.457703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a654-34c4-42d8-a044-13a40709c573 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.458024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a654-34c4-42d8-a044-13a40709c573 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.458996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96a654-34c4-42d8-a044-13a40709c573 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:41.460118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96a654-34c4-42d8-a044-13a40709c573 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:41.552581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 443/878] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:41 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:41.617497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cc9b-3411-4182-bfb9-80f65faf9776 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:41.732870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cc9b-3411-4182-bfb9-80f65faf9776 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:41.771411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:41.777958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82144f-fb45-4899-9ccc-e2712c2d3ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:41.784317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82144f-fb45-4899-9ccc-e2712c2d3ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.784317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82144f-fb45-4899-9ccc-e2712c2d3ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.784317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82144f-fb45-4899-9ccc-e2712c2d3ac8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.794401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82144f-fb45-4899-9ccc-e2712c2d3ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-3f82144f-fb45-4899-9ccc-e2712c2d3ac8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:41.799254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:41.800710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:41.801834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 436/879] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 22 12:27:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:41.808939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96a654-34c4-42d8-a044-13a40709c573 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:41.916143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96a654-34c4-42d8-a044-13a40709c573 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:41.952219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d80f1-cec6-48dd-8d01-2c43d3bb9954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:41.952850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d80f1-cec6-48dd-8d01-2c43d3bb9954 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.953141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d80f1-cec6-48dd-8d01-2c43d3bb9954 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.953418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d80f1-cec6-48dd-8d01-2c43d3bb9954 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.954096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d80f1-cec6-48dd-8d01-2c43d3bb9954 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:41.954441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d80f1-cec6-48dd-8d01-2c43d3bb9954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:41.956049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d80f1-cec6-48dd-8d01-2c43d3bb9954 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:41.965010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 444/880] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 22 12:27:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:41.970641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82144f-fb45-4899-9ccc-e2712c2d3ac8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:41.994029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048417-7477-4d7e-82b0-1faaf8eef749 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.994345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048417-7477-4d7e-82b0-1faaf8eef749 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.994532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048417-7477-4d7e-82b0-1faaf8eef749 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.996101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 445/881] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:42.001035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980a78e-0176-4c2e-be00-c2d756e61c0e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.001329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980a78e-0176-4c2e-be00-c2d756e61c0e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.001613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980a78e-0176-4c2e-be00-c2d756e61c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.020567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1980a78e-0176-4c2e-be00-c2d756e61c0e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:42.021864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1980a78e-0176-4c2e-be00-c2d756e61c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:42.051240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:42.088891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82144f-fb45-4899-9ccc-e2712c2d3ac8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.118567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 446/882] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:42.133711 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bca56-dce8-4608-8586-286e5a4ffc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.135768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bca56-dce8-4608-8586-286e5a4ffc19 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.136258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bca56-dce8-4608-8586-286e5a4ffc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.136797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bca56-dce8-4608-8586-286e5a4ffc19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.148073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bca56-dce8-4608-8586-286e5a4ffc19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.149838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bca56-dce8-4608-8586-286e5a4ffc19 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-1a0bca56-dce8-4608-8586-286e5a4ffc19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:42.166886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:42.167912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:42.168859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:42.168859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:42.168859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:42.171144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 437/883] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:42.184278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980a78e-0176-4c2e-be00-c2d756e61c0e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.289218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980a78e-0176-4c2e-be00-c2d756e61c0e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.325094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed141d82-7f4a-4735-a1a6-b071dad4bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.325708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed141d82-7f4a-4735-a1a6-b071dad4bec9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.326032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed141d82-7f4a-4735-a1a6-b071dad4bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.326342 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed141d82-7f4a-4735-a1a6-b071dad4bec9 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.326986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed141d82-7f4a-4735-a1a6-b071dad4bec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:42.327290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed141d82-7f4a-4735-a1a6-b071dad4bec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.328669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed141d82-7f4a-4735-a1a6-b071dad4bec9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.341090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 447/884] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:42.347523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bca56-dce8-4608-8586-286e5a4ffc19 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.393028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:42.428817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed141d82-7f4a-4735-a1a6-b071dad4bec9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.456320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bca56-dce8-4608-8586-286e5a4ffc19 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.463091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:42.504159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9887-b703-4867-9ee0-3a9b69428d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.504964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9887-b703-4867-9ee0-3a9b69428d0d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.505340 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9887-b703-4867-9ee0-3a9b69428d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.505682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9887-b703-4867-9ee0-3a9b69428d0d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.515369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed9887-b703-4867-9ee0-3a9b69428d0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.521291 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed9887-b703-4867-9ee0-3a9b69428d0d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-dbed9887-b703-4867-9ee0-3a9b69428d0d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:42.531628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:42.532573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:42.538499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 438/885] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:42.541255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9887-b703-4867-9ee0-3a9b69428d0d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.555664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed141d82-7f4a-4735-a1a6-b071dad4bec9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.601220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb12eb3-6789-41df-bbee-fd70eebc60fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.601863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb12eb3-6789-41df-bbee-fd70eebc60fa None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.602158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb12eb3-6789-41df-bbee-fd70eebc60fa None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.602460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb12eb3-6789-41df-bbee-fd70eebc60fa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.603053 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb12eb3-6789-41df-bbee-fd70eebc60fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.605007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb12eb3-6789-41df-bbee-fd70eebc60fa None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-1eb12eb3-6789-41df-bbee-fd70eebc60fa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:42.615476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:42.616417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:42.617333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:42.620118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 448/886] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:42.627069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb12eb3-6789-41df-bbee-fd70eebc60fa None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.663976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9887-b703-4867-9ee0-3a9b69428d0d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.667417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:42.700287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bc0c2-a649-48ce-a3bb-573676539dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.701554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bc0c2-a649-48ce-a3bb-573676539dfe None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.702088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bc0c2-a649-48ce-a3bb-573676539dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.703467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bc0c2-a649-48ce-a3bb-573676539dfe None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.704210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bc0c2-a649-48ce-a3bb-573676539dfe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:42.704520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bc0c2-a649-48ce-a3bb-573676539dfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.706056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bc0c2-a649-48ce-a3bb-573676539dfe None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.732789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 439/887] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:42.735320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bc0c2-a649-48ce-a3bb-573676539dfe None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.750407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:42.763858 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb12eb3-6789-41df-bbee-fd70eebc60fa None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.806030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f95fc2-1245-4b2f-b2fd-4002c49466cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.806839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f95fc2-1245-4b2f-b2fd-4002c49466cf None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.807753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f95fc2-1245-4b2f-b2fd-4002c49466cf None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.808127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f95fc2-1245-4b2f-b2fd-4002c49466cf None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.809000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f95fc2-1245-4b2f-b2fd-4002c49466cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:42.809541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f95fc2-1245-4b2f-b2fd-4002c49466cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.811382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f95fc2-1245-4b2f-b2fd-4002c49466cf None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.822951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 449/888] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:42.825249 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f95fc2-1245-4b2f-b2fd-4002c49466cf None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.866798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bc0c2-a649-48ce-a3bb-573676539dfe None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.903494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd38b80-3eb0-47ff-b985-cd6ed370b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.904130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd38b80-3eb0-47ff-b985-cd6ed370b220 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.904464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd38b80-3eb0-47ff-b985-cd6ed370b220 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.905361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd38b80-3eb0-47ff-b985-cd6ed370b220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.937204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:42.939839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f95fc2-1245-4b2f-b2fd-4002c49466cf None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.976955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694d0a2-77d0-4d4a-9b06-7df6a1f6bb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.977965 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d0a2-77d0-4d4a-9b06-7df6a1f6bb2e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.978497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d0a2-77d0-4d4a-9b06-7df6a1f6bb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.978977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d0a2-77d0-4d4a-9b06-7df6a1f6bb2e None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.979105 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd38b80-3eb0-47ff-b985-cd6ed370b220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.979949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694d0a2-77d0-4d4a-9b06-7df6a1f6bb2e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:42.980458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694d0a2-77d0-4d4a-9b06-7df6a1f6bb2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.980562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd38b80-3eb0-47ff-b985-cd6ed370b220 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.982126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694d0a2-77d0-4d4a-9b06-7df6a1f6bb2e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.993743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 450/889] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:42.995125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694d0a2-77d0-4d4a-9b06-7df6a1f6bb2e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.015659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.094649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 440/890] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:27:43.095890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd38b80-3eb0-47ff-b985-cd6ed370b220 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.107927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694d0a2-77d0-4d4a-9b06-7df6a1f6bb2e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.146457 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadf186-f037-477a-b80a-6e3eee330a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.147502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf186-f037-477a-b80a-6e3eee330a98 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.148010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf186-f037-477a-b80a-6e3eee330a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.148570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf186-f037-477a-b80a-6e3eee330a98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.149574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadf186-f037-477a-b80a-6e3eee330a98 None admin] RBAC: Adding query filter params (interface=public, service_id=83ec9e2f85464890aff5ed77e5978cf6, region_id=RegionOne) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:43.150102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadf186-f037-477a-b80a-6e3eee330a98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:43.151737 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadf186-f037-477a-b80a-6e3eee330a98 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:43.163009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.163355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 451/891] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/endpoints?service_id=83ec9e2f85464890aff5ed77e5978cf6&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:43.164436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadf186-f037-477a-b80a-6e3eee330a98 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.208257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd38b80-3eb0-47ff-b985-cd6ed370b220 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.245590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bed5e-81fc-4a7b-a066-3b19fa5d3d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.246273 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bed5e-81fc-4a7b-a066-3b19fa5d3d54 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.246563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bed5e-81fc-4a7b-a066-3b19fa5d3d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.246832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bed5e-81fc-4a7b-a066-3b19fa5d3d54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.257629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.259315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bed5e-81fc-4a7b-a066-3b19fa5d3d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:43.260571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bed5e-81fc-4a7b-a066-3b19fa5d3d54 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-2f6bed5e-81fc-4a7b-a066-3b19fa5d3d54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:43.276475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:43.277541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:43.278469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:43.278469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:43.278469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:43.281752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadf186-f037-477a-b80a-6e3eee330a98 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.282303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 441/892] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:43.283565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bed5e-81fc-4a7b-a066-3b19fa5d3d54 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.319389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ef762-e026-45f2-88cb-caeece789b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.320168 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ef762-e026-45f2-88cb-caeece789b6c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.320521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ef762-e026-45f2-88cb-caeece789b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.320811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ef762-e026-45f2-88cb-caeece789b6c None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.321413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ef762-e026-45f2-88cb-caeece789b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:43.322827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ef762-e026-45f2-88cb-caeece789b6c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:43.328612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 452/893] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:27:43.329739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08ac55-b71a-4c88-b68e-133a8e18d73b None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.329997 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08ac55-b71a-4c88-b68e-133a8e18d73b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.330512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08ac55-b71a-4c88-b68e-133a8e18d73b None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.332424 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 453/894] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:43.337587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfc55a-f63e-496c-9210-53f97b9ec226 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.337897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfc55a-f63e-496c-9210-53f97b9ec226 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.338157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfc55a-f63e-496c-9210-53f97b9ec226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.361726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9adfc55a-f63e-496c-9210-53f97b9ec226 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:43.363547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9adfc55a-f63e-496c-9210-53f97b9ec226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:43.422433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bed5e-81fc-4a7b-a066-3b19fa5d3d54 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.439104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.452175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 454/895] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:43.465284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a527cd-02a1-4450-8fe5-e4d02db99fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.466362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a527cd-02a1-4450-8fe5-e4d02db99fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.466851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a527cd-02a1-4450-8fe5-e4d02db99fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.467404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a527cd-02a1-4450-8fe5-e4d02db99fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.468262 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a527cd-02a1-4450-8fe5-e4d02db99fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:43.468792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a527cd-02a1-4450-8fe5-e4d02db99fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:43.470515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a527cd-02a1-4450-8fe5-e4d02db99fc1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:43.486413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 442/896] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:43.492811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfc55a-f63e-496c-9210-53f97b9ec226 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.574817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.586837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362d9ce-4d0f-4203-83a8-d8b0823c6b99 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.587130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362d9ce-4d0f-4203-83a8-d8b0823c6b99 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.587409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362d9ce-4d0f-4203-83a8-d8b0823c6b99 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.588800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 443/897] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:43.595255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4a6c-7756-41eb-9835-a508bfc3a62c None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.595830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4a6c-7756-41eb-9835-a508bfc3a62c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.596334 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4a6c-7756-41eb-9835-a508bfc3a62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.605927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfc55a-f63e-496c-9210-53f97b9ec226 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.619457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-2acf4a6c-7756-41eb-9835-a508bfc3a62c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:43.620997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2acf4a6c-7756-41eb-9835-a508bfc3a62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:43.646342 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ab389-3c60-4099-af6e-a52d3cbc8da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.647309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab389-3c60-4099-af6e-a52d3cbc8da2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.647801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab389-3c60-4099-af6e-a52d3cbc8da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.648282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab389-3c60-4099-af6e-a52d3cbc8da2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.657281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ab389-3c60-4099-af6e-a52d3cbc8da2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:43.660267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ab389-3c60-4099-af6e-a52d3cbc8da2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-080ab389-3c60-4099-af6e-a52d3cbc8da2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:43.678391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:43.679463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:43.680386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:43.680386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:43.680386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:43.680386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:43.680386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:43.680386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:43.680386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:43.680386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:43.680386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 455/898] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:43.689075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ab389-3c60-4099-af6e-a52d3cbc8da2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.708906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 444/899] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:43.741638 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4a6c-7756-41eb-9835-a508bfc3a62c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.815996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ab389-3c60-4099-af6e-a52d3cbc8da2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.853668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cec4a-e98a-46bb-9507-4ed40c8bbfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.854670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cec4a-e98a-46bb-9507-4ed40c8bbfcf None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.854857 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4a6c-7756-41eb-9835-a508bfc3a62c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.855416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cec4a-e98a-46bb-9507-4ed40c8bbfcf None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.855929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cec4a-e98a-46bb-9507-4ed40c8bbfcf None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.856826 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cec4a-e98a-46bb-9507-4ed40c8bbfcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:43.857379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cec4a-e98a-46bb-9507-4ed40c8bbfcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:43.859062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cec4a-e98a-46bb-9507-4ed40c8bbfcf None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:43.861163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.871507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.875152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 456/900] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:43.881359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cec4a-e98a-46bb-9507-4ed40c8bbfcf None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.909602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd41d-9194-4312-a470-1978d9489cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.911225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd41d-9194-4312-a470-1978d9489cca None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.912112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd41d-9194-4312-a470-1978d9489cca None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.912112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd41d-9194-4312-a470-1978d9489cca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.913515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fd41d-9194-4312-a470-1978d9489cca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:43.915199 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fd41d-9194-4312-a470-1978d9489cca None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-5f2fd41d-9194-4312-a470-1978d9489cca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:43.928015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:43.929119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:43.930011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:43.933830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 445/901] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:43.937321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd41d-9194-4312-a470-1978d9489cca None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.006761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cec4a-e98a-46bb-9507-4ed40c8bbfcf None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.042397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186f334-cda7-47df-af5a-0b1ada2b2373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.043021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186f334-cda7-47df-af5a-0b1ada2b2373 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.043307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186f334-cda7-47df-af5a-0b1ada2b2373 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.043588 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186f334-cda7-47df-af5a-0b1ada2b2373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.044336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186f334-cda7-47df-af5a-0b1ada2b2373 None admin] RBAC: Adding query filter params (role.id=3fd9779d8c3a49a1bb26d7bcd5c8ebff, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=be2fc683522941169708877bcfe2dc56) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:44.044650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186f334-cda7-47df-af5a-0b1ada2b2373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.046093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186f334-cda7-47df-af5a-0b1ada2b2373 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.046721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd41d-9194-4312-a470-1978d9489cca None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.054940 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 457/902] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/role_assignments?user.id=be2fc683522941169708877bcfe2dc56&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=3fd9779d8c3a49a1bb26d7bcd5c8ebff => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:44.055851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186f334-cda7-47df-af5a-0b1ada2b2373 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.088188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e54cb5-24dd-44ac-a006-12e2a910dc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.089185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e54cb5-24dd-44ac-a006-12e2a910dc72 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.089669 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e54cb5-24dd-44ac-a006-12e2a910dc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.090156 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e54cb5-24dd-44ac-a006-12e2a910dc72 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.091265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e54cb5-24dd-44ac-a006-12e2a910dc72 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:44.092063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e54cb5-24dd-44ac-a006-12e2a910dc72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.094773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e54cb5-24dd-44ac-a006-12e2a910dc72 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.101543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 446/903] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:44.107445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e54cb5-24dd-44ac-a006-12e2a910dc72 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.140493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:44.148509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:44.205110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186f334-cda7-47df-af5a-0b1ada2b2373 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.234839 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e54cb5-24dd-44ac-a006-12e2a910dc72 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.249407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edad85-36ef-4621-a9bd-0ea511744ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.250249 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edad85-36ef-4621-a9bd-0ea511744ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.250537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edad85-36ef-4621-a9bd-0ea511744ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.251188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edad85-36ef-4621-a9bd-0ea511744ae0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.252047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edad85-36ef-4621-a9bd-0ea511744ae0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.254219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edad85-36ef-4621-a9bd-0ea511744ae0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-18edad85-36ef-4621-a9bd-0ea511744ae0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:44.265900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:44.267139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:44.268184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 458/904] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:44.274556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce192498-6fe6-4b0b-9628-02f93ec97493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.275245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce192498-6fe6-4b0b-9628-02f93ec97493 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.275601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce192498-6fe6-4b0b-9628-02f93ec97493 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.275973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce192498-6fe6-4b0b-9628-02f93ec97493 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.276175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edad85-36ef-4621-a9bd-0ea511744ae0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.276787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce192498-6fe6-4b0b-9628-02f93ec97493 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:44.277098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce192498-6fe6-4b0b-9628-02f93ec97493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.278563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce192498-6fe6-4b0b-9628-02f93ec97493 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.294634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 447/905] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:44.393987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edad85-36ef-4621-a9bd-0ea511744ae0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.419343 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:44.431730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8df4-a4f5-4e4e-be8b-45e30a44349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.432358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8df4-a4f5-4e4e-be8b-45e30a44349e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.432644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8df4-a4f5-4e4e-be8b-45e30a44349e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.438821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8df4-a4f5-4e4e-be8b-45e30a44349e None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.438821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8df4-a4f5-4e4e-be8b-45e30a44349e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:44.438821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8df4-a4f5-4e4e-be8b-45e30a44349e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.438821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8df4-a4f5-4e4e-be8b-45e30a44349e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.441975 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 459/906] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:44.447742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce192498-6fe6-4b0b-9628-02f93ec97493 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.553931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:44.561271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce192498-6fe6-4b0b-9628-02f93ec97493 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.596784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afc7eb-86fe-48d1-8639-aed0c9e02c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.597383 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afc7eb-86fe-48d1-8639-aed0c9e02c54 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.597667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afc7eb-86fe-48d1-8639-aed0c9e02c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.597938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afc7eb-86fe-48d1-8639-aed0c9e02c54 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.598595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afc7eb-86fe-48d1-8639-aed0c9e02c54 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:44.598898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afc7eb-86fe-48d1-8639-aed0c9e02c54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.600494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afc7eb-86fe-48d1-8639-aed0c9e02c54 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.610280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 448/907] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:44.611292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8df4-a4f5-4e4e-be8b-45e30a44349e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.721031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8df4-a4f5-4e4e-be8b-45e30a44349e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.761975 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b6596-992b-4dad-9101-31573afc3be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.763137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b6596-992b-4dad-9101-31573afc3be5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.763638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b6596-992b-4dad-9101-31573afc3be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.764146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b6596-992b-4dad-9101-31573afc3be5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.765070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b6596-992b-4dad-9101-31573afc3be5 None admin] RBAC: Adding query filter params (interface=public, service_id=4ab73bff5afe477b975bddc6e16ccccd, region_id=RegionOne) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:44.765644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b6596-992b-4dad-9101-31573afc3be5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.767331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b6596-992b-4dad-9101-31573afc3be5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.774041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 460/908] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/endpoints?service_id=4ab73bff5afe477b975bddc6e16ccccd&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:44.779922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afc7eb-86fe-48d1-8639-aed0c9e02c54 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.888939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afc7eb-86fe-48d1-8639-aed0c9e02c54 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.926507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8797-0056-429f-b5cf-ce71edfad00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.927166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8797-0056-429f-b5cf-ce71edfad00e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.927455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8797-0056-429f-b5cf-ce71edfad00e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.927725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8797-0056-429f-b5cf-ce71edfad00e None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.928327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd8797-0056-429f-b5cf-ce71edfad00e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.929692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd8797-0056-429f-b5cf-ce71edfad00e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.935914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 449/909] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:27:45.351230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c46e1-0c98-4096-91ce-295d514228b2 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.351774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c46e1-0c98-4096-91ce-295d514228b2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.351774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c46e1-0c98-4096-91ce-295d514228b2 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.353341 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 461/910] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:45.358858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34bcf7-505d-405f-b7bc-165fb88e305a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.359151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34bcf7-505d-405f-b7bc-165fb88e305a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.359432 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34bcf7-505d-405f-b7bc-165fb88e305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.379355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-cb34bcf7-505d-405f-b7bc-165fb88e305a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:45.380558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cb34bcf7-505d-405f-b7bc-165fb88e305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:45.399598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:45.454735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 450/911] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:45.727027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c46e1-0c98-4096-91ce-295d514228b2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.779544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:45.837618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c46e1-0c98-4096-91ce-295d514228b2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.873137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2497d07-c66b-4c1b-ab3e-206cf517bb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.873778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2497d07-c66b-4c1b-ab3e-206cf517bb15 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.874060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2497d07-c66b-4c1b-ab3e-206cf517bb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.874419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2497d07-c66b-4c1b-ab3e-206cf517bb15 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.875012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2497d07-c66b-4c1b-ab3e-206cf517bb15 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.876401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2497d07-c66b-4c1b-ab3e-206cf517bb15 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-e2497d07-c66b-4c1b-ab3e-206cf517bb15 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:45.886157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:45.887204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:45.888181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 462/912] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:45.894227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34bcf7-505d-405f-b7bc-165fb88e305a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:46.000976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34bcf7-505d-405f-b7bc-165fb88e305a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.037911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18780196-609e-4b53-8816-36bb70ab7a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.038557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18780196-609e-4b53-8816-36bb70ab7a00 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.038840 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18780196-609e-4b53-8816-36bb70ab7a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.039111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18780196-609e-4b53-8816-36bb70ab7a00 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.039745 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18780196-609e-4b53-8816-36bb70ab7a00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:46.040051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18780196-609e-4b53-8816-36bb70ab7a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.041421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18780196-609e-4b53-8816-36bb70ab7a00 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.046865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 451/913] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:46.053313 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2497d07-c66b-4c1b-ab3e-206cf517bb15 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:46.112610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bfee9-6cab-4084-8ce3-df29c5ef3561 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.112954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bfee9-6cab-4084-8ce3-df29c5ef3561 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.113227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bfee9-6cab-4084-8ce3-df29c5ef3561 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.114945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 452/914] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:46.119909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf788ffa-cc1d-4444-b5fa-a7692fec8e30 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.120191 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf788ffa-cc1d-4444-b5fa-a7692fec8e30 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.120466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf788ffa-cc1d-4444-b5fa-a7692fec8e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.139495 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-bf788ffa-cc1d-4444-b5fa-a7692fec8e30 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:46.140790 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bf788ffa-cc1d-4444-b5fa-a7692fec8e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:46.155784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:46.173813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2497d07-c66b-4c1b-ab3e-206cf517bb15 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.194572 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:46.226229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ab8f2-30c5-44de-9a49-7ef7a5ed282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.226229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab8f2-30c5-44de-9a49-7ef7a5ed282f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.226229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab8f2-30c5-44de-9a49-7ef7a5ed282f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.226229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab8f2-30c5-44de-9a49-7ef7a5ed282f None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.226643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ab8f2-30c5-44de-9a49-7ef7a5ed282f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:46.226643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ab8f2-30c5-44de-9a49-7ef7a5ed282f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.226643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ab8f2-30c5-44de-9a49-7ef7a5ed282f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.227142 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 453/915] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:46.232022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 463/916] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:46.238096 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf788ffa-cc1d-4444-b5fa-a7692fec8e30 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:46.313413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd1b0-cf6c-44b4-a0e8-df64a434c458 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.313744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd1b0-cf6c-44b4-a0e8-df64a434c458 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.314254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd1b0-cf6c-44b4-a0e8-df64a434c458 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.316426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 464/917] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:46.325560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7601bb-7906-41b1-a6c6-75d7da7508b0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.325866 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7601bb-7906-41b1-a6c6-75d7da7508b0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.327808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7601bb-7906-41b1-a6c6-75d7da7508b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.353647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-cc7601bb-7906-41b1-a6c6-75d7da7508b0 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:46.358218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cc7601bb-7906-41b1-a6c6-75d7da7508b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:46.390215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf788ffa-cc1d-4444-b5fa-a7692fec8e30 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.436919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cf57f-a5c7-459f-90ec-70fb54a8d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.437537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cf57f-a5c7-459f-90ec-70fb54a8d4b8 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.437819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cf57f-a5c7-459f-90ec-70fb54a8d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.438094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cf57f-a5c7-459f-90ec-70fb54a8d4b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.438809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cf57f-a5c7-459f-90ec-70fb54a8d4b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.440736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cf57f-a5c7-459f-90ec-70fb54a8d4b8 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.453478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 465/918] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:46.526762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7601bb-7906-41b1-a6c6-75d7da7508b0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:46.568005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 454/919] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:27:46.676186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7601bb-7906-41b1-a6c6-75d7da7508b0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.692499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:46.738726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84344a0d-c621-40c7-9478-069698b9b144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.739656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84344a0d-c621-40c7-9478-069698b9b144 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.740090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84344a0d-c621-40c7-9478-069698b9b144 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.740498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84344a0d-c621-40c7-9478-069698b9b144 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.745841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cf57f-a5c7-459f-90ec-70fb54a8d4b8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:46.749692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:46.753307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84344a0d-c621-40c7-9478-069698b9b144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-84344a0d-c621-40c7-9478-069698b9b144 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:46.758465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:46.765553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:46.766480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:46.767369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 466/920] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 22 12:27:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:46.769967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84344a0d-c621-40c7-9478-069698b9b144 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:46.888151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cf57f-a5c7-459f-90ec-70fb54a8d4b8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.933409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84344a0d-c621-40c7-9478-069698b9b144 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.938731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497d1d2-d432-4779-9fe7-746948523ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.939930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497d1d2-d432-4779-9fe7-746948523ae0 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.941036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497d1d2-d432-4779-9fe7-746948523ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.941570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497d1d2-d432-4779-9fe7-746948523ae0 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.942534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497d1d2-d432-4779-9fe7-746948523ae0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.944592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497d1d2-d432-4779-9fe7-746948523ae0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.968995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fdaa2-1df9-4473-a688-3d71e748e6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.969606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fdaa2-1df9-4473-a688-3d71e748e6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.969888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fdaa2-1df9-4473-a688-3d71e748e6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.970162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fdaa2-1df9-4473-a688-3d71e748e6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.970852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fdaa2-1df9-4473-a688-3d71e748e6e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:46.971161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fdaa2-1df9-4473-a688-3d71e748e6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.972591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fdaa2-1df9-4473-a688-3d71e748e6e8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.980482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 467/921] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 22 12:27:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:46.981638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36819c-1874-4aa1-aa6a-554f7bba02c9 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.981926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36819c-1874-4aa1-aa6a-554f7bba02c9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.982218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36819c-1874-4aa1-aa6a-554f7bba02c9 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.985381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 468/922] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:46.986322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36819c-1874-4aa1-aa6a-554f7bba02c9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.015076 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:47.020527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 455/923] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:46 2022] POST /identity/v3/services => generated 241 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:27:47.022083 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b71ee2-5206-41d6-8001-26b28553ac36 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.022461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b71ee2-5206-41d6-8001-26b28553ac36 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.022800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b71ee2-5206-41d6-8001-26b28553ac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.043938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e0b71ee2-5206-41d6-8001-26b28553ac36 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:47.045418 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e0b71ee2-5206-41d6-8001-26b28553ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:47.117835 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:47.133861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 456/924] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:47.136320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36819c-1874-4aa1-aa6a-554f7bba02c9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:47.187312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cc522-3eb4-497e-b79c-9b3f227207f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:47.187955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cc522-3eb4-497e-b79c-9b3f227207f5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.188237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cc522-3eb4-497e-b79c-9b3f227207f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.188513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cc522-3eb4-497e-b79c-9b3f227207f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.200338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cc522-3eb4-497e-b79c-9b3f227207f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:47.201802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cc522-3eb4-497e-b79c-9b3f227207f5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-488cc522-3eb4-497e-b79c-9b3f227207f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:47.217470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:47.218562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:47.219483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:47.219483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:47.219483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:47.219483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 469/925] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:47.224445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b71ee2-5206-41d6-8001-26b28553ac36 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.332485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b71ee2-5206-41d6-8001-26b28553ac36 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:47.369143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619917f4-885b-4a02-810c-144e6be08f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:47.369751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619917f4-885b-4a02-810c-144e6be08f1e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.370029 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619917f4-885b-4a02-810c-144e6be08f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.370330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619917f4-885b-4a02-810c-144e6be08f1e None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.371028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619917f4-885b-4a02-810c-144e6be08f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:47.371327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619917f4-885b-4a02-810c-144e6be08f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:47.372734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619917f4-885b-4a02-810c-144e6be08f1e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:47.389727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 457/926] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:47.391151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cc522-3eb4-497e-b79c-9b3f227207f5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.424285 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619917f4-885b-4a02-810c-144e6be08f1e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.477573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:47.478514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:47.501673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cc522-3eb4-497e-b79c-9b3f227207f5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:47.529900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619917f4-885b-4a02-810c-144e6be08f1e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:47.538238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a700a6-a129-48b1-86aa-f5d43695eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:47.539086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a700a6-a129-48b1-86aa-f5d43695eb44 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.539537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a700a6-a129-48b1-86aa-f5d43695eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.539967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a700a6-a129-48b1-86aa-f5d43695eb44 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.548021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a700a6-a129-48b1-86aa-f5d43695eb44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:47.550848 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a700a6-a129-48b1-86aa-f5d43695eb44 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c9a700a6-a129-48b1-86aa-f5d43695eb44 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:47.564970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:47.567810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:47.568794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:47.568794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:47.568794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:47.568794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:47.568794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:47.568794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:47.568794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:47.568794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:47.568794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:47.568794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:47.571259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 470/927] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:47.575639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a700a6-a129-48b1-86aa-f5d43695eb44 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.575752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f040b1-bc53-4dbe-9a7d-bc6a10464bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:47.575752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f040b1-bc53-4dbe-9a7d-bc6a10464bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.575752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f040b1-bc53-4dbe-9a7d-bc6a10464bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.575752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f040b1-bc53-4dbe-9a7d-bc6a10464bb8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.576041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f040b1-bc53-4dbe-9a7d-bc6a10464bb8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:47.578705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f040b1-bc53-4dbe-9a7d-bc6a10464bb8 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-68f040b1-bc53-4dbe-9a7d-bc6a10464bb8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:47.590784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:47.591841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:47.592715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:47.601066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 458/928] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:47.601790 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f040b1-bc53-4dbe-9a7d-bc6a10464bb8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.700838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a700a6-a129-48b1-86aa-f5d43695eb44 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:47.724791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f040b1-bc53-4dbe-9a7d-bc6a10464bb8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:47.738988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c09c33-59ac-4b47-a290-5dc94478f837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:47.739970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c09c33-59ac-4b47-a290-5dc94478f837 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.740474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c09c33-59ac-4b47-a290-5dc94478f837 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.740963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c09c33-59ac-4b47-a290-5dc94478f837 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.741899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c09c33-59ac-4b47-a290-5dc94478f837 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:47.742439 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c09c33-59ac-4b47-a290-5dc94478f837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:47.744083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c09c33-59ac-4b47-a290-5dc94478f837 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:47.753430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:47.762022 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53c41e-b191-42d2-bf87-f76d50b1885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:47.762640 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53c41e-b191-42d2-bf87-f76d50b1885d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.762920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53c41e-b191-42d2-bf87-f76d50b1885d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.763193 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53c41e-b191-42d2-bf87-f76d50b1885d None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.763815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53c41e-b191-42d2-bf87-f76d50b1885d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:47.764115 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53c41e-b191-42d2-bf87-f76d50b1885d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:47.765581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53c41e-b191-42d2-bf87-f76d50b1885d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:47.766023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 471/929] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:47.771922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:47.772580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c09c33-59ac-4b47-a290-5dc94478f837 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.785063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 459/930] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:47.786287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53c41e-b191-42d2-bf87-f76d50b1885d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.885983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c09c33-59ac-4b47-a290-5dc94478f837 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:47.898747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53c41e-b191-42d2-bf87-f76d50b1885d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:47.922525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61551b-418b-4b79-a9e7-67bd99839f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:47.923243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61551b-418b-4b79-a9e7-67bd99839f67 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.923591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61551b-418b-4b79-a9e7-67bd99839f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.923934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61551b-418b-4b79-a9e7-67bd99839f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.934655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61551b-418b-4b79-a9e7-67bd99839f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:47.936228 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61551b-418b-4b79-a9e7-67bd99839f67 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:47.937233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754fda-ffcd-4a71-bd15-31d4be651512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:47.938043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754fda-ffcd-4a71-bd15-31d4be651512 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.938540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754fda-ffcd-4a71-bd15-31d4be651512 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.939052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754fda-ffcd-4a71-bd15-31d4be651512 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.940850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3754fda-ffcd-4a71-bd15-31d4be651512 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:47.941352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3754fda-ffcd-4a71-bd15-31d4be651512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:47.942998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3754fda-ffcd-4a71-bd15-31d4be651512 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-8f61551b-418b-4b79-a9e7-67bd99839f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:47.953178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:47.954124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:47.955359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:47.955359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:47.955359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:47.955745 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 460/932] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:47.957289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754fda-ffcd-4a71-bd15-31d4be651512 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.959566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 472/932] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:47.960783 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61551b-418b-4b79-a9e7-67bd99839f67 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.004785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:48.011907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:48.064825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61551b-418b-4b79-a9e7-67bd99839f67 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.067250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754fda-ffcd-4a71-bd15-31d4be651512 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.102098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86beb9-0291-4017-89ae-d47effcbfb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.102889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86beb9-0291-4017-89ae-d47effcbfb80 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.103227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86beb9-0291-4017-89ae-d47effcbfb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.103577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86beb9-0291-4017-89ae-d47effcbfb80 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.104304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86beb9-0291-4017-89ae-d47effcbfb80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:48.104672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86beb9-0291-4017-89ae-d47effcbfb80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.105932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0aeed-7e6a-46f0-905e-108646c9720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.106242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86beb9-0291-4017-89ae-d47effcbfb80 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.106948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0aeed-7e6a-46f0-905e-108646c9720a None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.107395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0aeed-7e6a-46f0-905e-108646c9720a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.107829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0aeed-7e6a-46f0-905e-108646c9720a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.108654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0aeed-7e6a-46f0-905e-108646c9720a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.110173 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0aeed-7e6a-46f0-905e-108646c9720a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.122627 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 473/933] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:48.125637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86beb9-0291-4017-89ae-d47effcbfb80 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.226317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 461/934] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:48.259527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86beb9-0291-4017-89ae-d47effcbfb80 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.271031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:48.306106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde5ca8-106d-4930-96e3-13138019e4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.306833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5ca8-106d-4930-96e3-13138019e4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.307120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5ca8-106d-4930-96e3-13138019e4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.307398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5ca8-106d-4930-96e3-13138019e4f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.314986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde5ca8-106d-4930-96e3-13138019e4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.317424 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde5ca8-106d-4930-96e3-13138019e4f9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-7dde5ca8-106d-4930-96e3-13138019e4f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:48.330013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:48.331100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:48.332543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:48.332543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:48.332543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:48.332543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:48.332543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:48.332543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:48.332543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:48.332543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:48.332543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 474/935] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:48.339695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0aeed-7e6a-46f0-905e-108646c9720a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.448355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:48.453516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0aeed-7e6a-46f0-905e-108646c9720a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.490414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4296950-0d63-4bb3-b3e3-9d537ad1280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.491153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4296950-0d63-4bb3-b3e3-9d537ad1280d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.491443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4296950-0d63-4bb3-b3e3-9d537ad1280d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.491790 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4296950-0d63-4bb3-b3e3-9d537ad1280d None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.492556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4296950-0d63-4bb3-b3e3-9d537ad1280d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:48.492887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4296950-0d63-4bb3-b3e3-9d537ad1280d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.494464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4296950-0d63-4bb3-b3e3-9d537ad1280d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.507904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 462/936] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:48.513985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde5ca8-106d-4930-96e3-13138019e4f9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.621608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde5ca8-106d-4930-96e3-13138019e4f9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.658648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e53a9-6587-4869-be23-727b01377480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.659849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e53a9-6587-4869-be23-727b01377480 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.660139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e53a9-6587-4869-be23-727b01377480 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.660413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e53a9-6587-4869-be23-727b01377480 None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/be2fc683522941169708877bcfe2dc56/roles/3fd9779d8c3a49a1bb26d7bcd5c8ebff` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.662695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e53a9-6587-4869-be23-727b01377480 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=be2fc683522941169708877bcfe2dc56, role_id=3fd9779d8c3a49a1bb26d7bcd5c8ebff)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.664225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e53a9-6587-4869-be23-727b01377480 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.676326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c3da-443d-4ec0-9e6f-406d90b567ec None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.678427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c3da-443d-4ec0-9e6f-406d90b567ec None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.678427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c3da-443d-4ec0-9e6f-406d90b567ec None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.678862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 463/937] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:48.683923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1cc3-9d50-468b-8a43-de393b92663a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.684211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1cc3-9d50-468b-8a43-de393b92663a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.684490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1cc3-9d50-468b-8a43-de393b92663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.703849 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-f57c1cc3-9d50-468b-8a43-de393b92663a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:48.705074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f57c1cc3-9d50-468b-8a43-de393b92663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:48.733617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 475/938] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:48 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/be2fc683522941169708877bcfe2dc56/roles/3fd9779d8c3a49a1bb26d7bcd5c8ebff => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:27:48.794938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 464/939] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:49.035643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95dc3-5a26-4ec7-afdc-45d337742d27 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.036018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95dc3-5a26-4ec7-afdc-45d337742d27 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.036210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95dc3-5a26-4ec7-afdc-45d337742d27 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.037810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 476/940] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:49.043095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e8033-9083-4cad-a9f2-2b680d76031b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.043553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e8033-9083-4cad-a9f2-2b680d76031b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.043652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e8033-9083-4cad-a9f2-2b680d76031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.062080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-bd6e8033-9083-4cad-a9f2-2b680d76031b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:49.063289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bd6e8033-9083-4cad-a9f2-2b680d76031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:49.071964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95dc3-5a26-4ec7-afdc-45d337742d27 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.100764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.154516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 465/941] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:49.191702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95dc3-5a26-4ec7-afdc-45d337742d27 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.229328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec8cd4-80be-427f-b737-2068a77dcfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.229963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec8cd4-80be-427f-b737-2068a77dcfae None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.230268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec8cd4-80be-427f-b737-2068a77dcfae None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.230549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec8cd4-80be-427f-b737-2068a77dcfae None admin] PATH_INFO: `/v3/services/compute` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.231139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec8cd4-80be-427f-b737-2068a77dcfae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.232517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec8cd4-80be-427f-b737-2068a77dcfae None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-a4ec8cd4-80be-427f-b737-2068a77dcfae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:49.242036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:49.243058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:49.243927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 477/942] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:49.249243 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e8033-9083-4cad-a9f2-2b680d76031b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.269407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.361539 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e8033-9083-4cad-a9f2-2b680d76031b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.399071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a88571-928c-458d-8059-149df688a487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.400108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a88571-928c-458d-8059-149df688a487 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.400603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a88571-928c-458d-8059-149df688a487 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.401089 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a88571-928c-458d-8059-149df688a487 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.401935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a88571-928c-458d-8059-149df688a487 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:49.402472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a88571-928c-458d-8059-149df688a487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.404047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a88571-928c-458d-8059-149df688a487 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.409502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 466/943] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:49.414926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec8cd4-80be-427f-b737-2068a77dcfae None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.448678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a88571-928c-458d-8059-149df688a487 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.514454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.528945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec8cd4-80be-427f-b737-2068a77dcfae None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.537933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.556373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a88571-928c-458d-8059-149df688a487 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.568839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe83c8-8652-4a4a-9719-b5768d5972ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.570016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe83c8-8652-4a4a-9719-b5768d5972ec None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.570568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe83c8-8652-4a4a-9719-b5768d5972ec None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.571210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe83c8-8652-4a4a-9719-b5768d5972ec None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.572370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe83c8-8652-4a4a-9719-b5768d5972ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:49.572833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe83c8-8652-4a4a-9719-b5768d5972ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.574789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe83c8-8652-4a4a-9719-b5768d5972ec None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.586753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 478/944] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:49.598573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a8cb6-494e-46ff-8c04-ff25af9d88c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.599230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a8cb6-494e-46ff-8c04-ff25af9d88c3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.599501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a8cb6-494e-46ff-8c04-ff25af9d88c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.599783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a8cb6-494e-46ff-8c04-ff25af9d88c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.600366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a8cb6-494e-46ff-8c04-ff25af9d88c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.601756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a8cb6-494e-46ff-8c04-ff25af9d88c3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-017a8cb6-494e-46ff-8c04-ff25af9d88c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:49.611525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:49.613729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:49.615782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 467/945] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:49.621110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe83c8-8652-4a4a-9719-b5768d5972ec None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.731786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe83c8-8652-4a4a-9719-b5768d5972ec None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.775147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9527ff-6592-4672-aac1-ab156c16adb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.776126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9527ff-6592-4672-aac1-ab156c16adb8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.776652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9527ff-6592-4672-aac1-ab156c16adb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.777150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9527ff-6592-4672-aac1-ab156c16adb8 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.777986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9527ff-6592-4672-aac1-ab156c16adb8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:49.778522 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9527ff-6592-4672-aac1-ab156c16adb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.780106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9527ff-6592-4672-aac1-ab156c16adb8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.785694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 479/946] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:49.791199 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a8cb6-494e-46ff-8c04-ff25af9d88c3 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.901136 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a8cb6-494e-46ff-8c04-ff25af9d88c3 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.935821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa86c3-f0ab-4660-8f3c-91807c778817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.936434 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa86c3-f0ab-4660-8f3c-91807c778817 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.936710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa86c3-f0ab-4660-8f3c-91807c778817 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.936981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa86c3-f0ab-4660-8f3c-91807c778817 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.937612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa86c3-f0ab-4660-8f3c-91807c778817 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:49.937909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa86c3-f0ab-4660-8f3c-91807c778817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.939313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa86c3-f0ab-4660-8f3c-91807c778817 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.945197 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 468/947] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:49.951042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9527ff-6592-4672-aac1-ab156c16adb8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.970095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:50.055210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9527ff-6592-4672-aac1-ab156c16adb8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:50.089481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f42b89-a51a-4c26-aa8c-0c03e24ae06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:50.090094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f42b89-a51a-4c26-aa8c-0c03e24ae06d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.090396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f42b89-a51a-4c26-aa8c-0c03e24ae06d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.090673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f42b89-a51a-4c26-aa8c-0c03e24ae06d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.091377 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f42b89-a51a-4c26-aa8c-0c03e24ae06d None admin] RBAC: Adding query filter params (interface=public, service_id=8dd1c31b35d54bc48d006cce4c5e903b, region_id=RegionOne) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:50.091686 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f42b89-a51a-4c26-aa8c-0c03e24ae06d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:50.093068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f42b89-a51a-4c26-aa8c-0c03e24ae06d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:50.099222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 480/948] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/endpoints?service_id=8dd1c31b35d54bc48d006cce4c5e903b&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:50.104715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa86c3-f0ab-4660-8f3c-91807c778817 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:50.118697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:50.209654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa86c3-f0ab-4660-8f3c-91807c778817 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:50.244276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad59819-b8fe-4c60-a2b4-e73fa0b44525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:50.244884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59819-b8fe-4c60-a2b4-e73fa0b44525 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.245161 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59819-b8fe-4c60-a2b4-e73fa0b44525 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.245431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59819-b8fe-4c60-a2b4-e73fa0b44525 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.246030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad59819-b8fe-4c60-a2b4-e73fa0b44525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:50.247421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad59819-b8fe-4c60-a2b4-e73fa0b44525 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:50.254214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 469/949] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:50 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:27:50.342073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b8cd-7b84-472b-92cf-9ae58ad84d9d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.342403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b8cd-7b84-472b-92cf-9ae58ad84d9d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.342649 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b8cd-7b84-472b-92cf-9ae58ad84d9d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.344260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 481/950] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:50.350917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea4cd2-47eb-455f-a4b6-6ce7616093a6 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.351322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea4cd2-47eb-455f-a4b6-6ce7616093a6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.351696 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea4cd2-47eb-455f-a4b6-6ce7616093a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.371120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-0cea4cd2-47eb-455f-a4b6-6ce7616093a6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:50.372338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0cea4cd2-47eb-455f-a4b6-6ce7616093a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:50.446120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 470/951] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:50.724491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356b8cd-7b84-472b-92cf-9ae58ad84d9d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:50.748000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbad6-917a-4c6d-82f5-f21a2d837d6e None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.748282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbad6-917a-4c6d-82f5-f21a2d837d6e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.748557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbad6-917a-4c6d-82f5-f21a2d837d6e None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.750129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 471/952] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:50.756777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a7df6-14fd-4607-9aff-a7934deb988f None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.757059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a7df6-14fd-4607-9aff-a7934deb988f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.757580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a7df6-14fd-4607-9aff-a7934deb988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.766705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:50.781354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-b00a7df6-14fd-4607-9aff-a7934deb988f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:50.783660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b00a7df6-14fd-4607-9aff-a7934deb988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:50.822732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:50.842923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356b8cd-7b84-472b-92cf-9ae58ad84d9d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:50.878669 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 472/953] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:50.893959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:50.894659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.894947 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.895218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.895866 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:50.897371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:50.900119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: WARNING keystone.server.flask.common [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 12:27:50.951994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.sql.core [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 12:27:50.951994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 12:27:50.951994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [parameters: {'id': '9237b60da7ae412c8a31d306d2778de9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 12:27:50.951994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81819) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9237b60da7ae412c8a31d306d2778de9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9237b60da7ae412c8a31d306d2778de9. Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:27:50.969330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application result.read() Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 12:27:50.970164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application yield resource Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise self.value Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application session.commit() Aug 22 12:27:50.971173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self.session.flush() Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application compat.raise_( Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 12:27:50.972647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 12:27:50.973582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application result.read() Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:27:50.975536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [parameters: {'id': '9237b60da7ae412c8a31d306d2778de9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:50.977100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:50.978245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:50.979492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:50.979492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 12:27:50.979492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 12:27:50.979492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:50.979492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:50.979492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 12:27:50.979492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 12:27:50.979492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9237b60da7ae412c8a31d306d2778de9. Aug 22 12:27:50.979492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:50.979492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 482/954] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Aug 22 12:27:50 2022] POST /identity/v3/projects => generated 262 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:50.980220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a7df6-14fd-4607-9aff-a7934deb988f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:51.087423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a7df6-14fd-4607-9aff-a7934deb988f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:51.122772 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bd883-461e-4fa0-b98b-a0b6fe465535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:51.123491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd883-461e-4fa0-b98b-a0b6fe465535 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.123718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd883-461e-4fa0-b98b-a0b6fe465535 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.123998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd883-461e-4fa0-b98b-a0b6fe465535 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.125926 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:51.131666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bd883-461e-4fa0-b98b-a0b6fe465535 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:51.133112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bd883-461e-4fa0-b98b-a0b6fe465535 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-600bd883-461e-4fa0-b98b-a0b6fe465535 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:51.144582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:51.146676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:51.148021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:51.148021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:51.148021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:51.148021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:51.148021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:51.148021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:51.148021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:51.148021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:51.148021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 473/955] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:51.152058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:51.177861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bd883-461e-4fa0-b98b-a0b6fe465535 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:51.262945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720ab3c-96c6-4039-b35f-85997aa7ff81 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:51.281217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bd883-461e-4fa0-b98b-a0b6fe465535 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:51.302377 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbc09e-fcb4-426f-b014-f93a8a2125ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:51.303105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc09e-fcb4-426f-b014-f93a8a2125ec None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.303395 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc09e-fcb4-426f-b014-f93a8a2125ec None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.303676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc09e-fcb4-426f-b014-f93a8a2125ec None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.304353 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbc09e-fcb4-426f-b014-f93a8a2125ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:51.304665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbc09e-fcb4-426f-b014-f93a8a2125ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:51.306590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbc09e-fcb4-426f-b014-f93a8a2125ec None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:51.310763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:51.317739 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe14e5a-51c8-4b2d-90eb-a045e06a7152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:51.318178 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe14e5a-51c8-4b2d-90eb-a045e06a7152 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.318486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe14e5a-51c8-4b2d-90eb-a045e06a7152 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.318757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe14e5a-51c8-4b2d-90eb-a045e06a7152 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.330261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe14e5a-51c8-4b2d-90eb-a045e06a7152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:51.331511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 483/956] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-1fe14e5a-51c8-4b2d-90eb-a045e06a7152 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:51.335519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:51.337750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:51.339905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:51.343548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 474/957] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 22 12:27:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:51.343771 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbc09e-fcb4-426f-b014-f93a8a2125ec None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:51.457007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbc09e-fcb4-426f-b014-f93a8a2125ec None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:51.494783 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9d466-b2e8-482a-ac20-acfd0aaa0d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:51.495335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9d466-b2e8-482a-ac20-acfd0aaa0d18 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.495622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9d466-b2e8-482a-ac20-acfd0aaa0d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.495903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9d466-b2e8-482a-ac20-acfd0aaa0d18 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.496638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9d466-b2e8-482a-ac20-acfd0aaa0d18 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:51.496955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9d466-b2e8-482a-ac20-acfd0aaa0d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:51.498366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9d466-b2e8-482a-ac20-acfd0aaa0d18 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:51.507448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 484/958] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 22 12:27:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:51.517259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe14e5a-51c8-4b2d-90eb-a045e06a7152 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:51.575121 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:51.622931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe14e5a-51c8-4b2d-90eb-a045e06a7152 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:51.659627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141d7e7-c28f-4912-8050-9f64b2156727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:51.660276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141d7e7-c28f-4912-8050-9f64b2156727 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.660558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141d7e7-c28f-4912-8050-9f64b2156727 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.660833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141d7e7-c28f-4912-8050-9f64b2156727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.672214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141d7e7-c28f-4912-8050-9f64b2156727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:51.673664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141d7e7-c28f-4912-8050-9f64b2156727 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-8141d7e7-c28f-4912-8050-9f64b2156727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:51.691020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:51.692147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:51.693067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:51.693067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:51.693067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:51.693067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 475/959] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:51.695917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f06a2f-b954-46f5-b6ba-359385f73617 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.696362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f06a2f-b954-46f5-b6ba-359385f73617 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.696728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f06a2f-b954-46f5-b6ba-359385f73617 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.698654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 485/960] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:51.700808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141d7e7-c28f-4912-8050-9f64b2156727 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:51.706475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177196a-297d-45b1-8d3f-7498aaf41eea None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.706475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177196a-297d-45b1-8d3f-7498aaf41eea None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.706475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177196a-297d-45b1-8d3f-7498aaf41eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.726230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8177196a-297d-45b1-8d3f-7498aaf41eea None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:51.727716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8177196a-297d-45b1-8d3f-7498aaf41eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:51.785598 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:51.801755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 486/961] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:51.833339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141d7e7-c28f-4912-8050-9f64b2156727 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:51.841207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:51.870682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08655a-a910-4c2f-b421-f655c3a47a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:51.871821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08655a-a910-4c2f-b421-f655c3a47a17 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.872344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08655a-a910-4c2f-b421-f655c3a47a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.872829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08655a-a910-4c2f-b421-f655c3a47a17 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.873691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08655a-a910-4c2f-b421-f655c3a47a17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:51.874242 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08655a-a910-4c2f-b421-f655c3a47a17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:51.875809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08655a-a910-4c2f-b421-f655c3a47a17 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:51.889419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 476/962] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:51.896383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177196a-297d-45b1-8d3f-7498aaf41eea None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.010542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177196a-297d-45b1-8d3f-7498aaf41eea None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.051717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e44537-07a0-47d6-ae7c-d5bd36c21ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.053167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e44537-07a0-47d6-ae7c-d5bd36c21ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.053682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e44537-07a0-47d6-ae7c-d5bd36c21ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.054177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e44537-07a0-47d6-ae7c-d5bd36c21ce5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.062243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e44537-07a0-47d6-ae7c-d5bd36c21ce5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.063987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e44537-07a0-47d6-ae7c-d5bd36c21ce5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f7e44537-07a0-47d6-ae7c-d5bd36c21ce5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:52.076501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:52.077499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:52.078500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:52.078500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:52.078500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:52.078500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:52.078500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:52.078500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:52.078500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:52.078500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:52.078500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:52.078500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:52.081210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 487/963] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:52.087246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08655a-a910-4c2f-b421-f655c3a47a17 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.089404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e44537-07a0-47d6-ae7c-d5bd36c21ce5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.161486 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:52.210882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08655a-a910-4c2f-b421-f655c3a47a17 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.238592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e44537-07a0-47d6-ae7c-d5bd36c21ce5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.251679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb50b-22ad-4de2-86f3-1c51059defa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.252809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb50b-22ad-4de2-86f3-1c51059defa0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.253337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb50b-22ad-4de2-86f3-1c51059defa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.253822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb50b-22ad-4de2-86f3-1c51059defa0 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.254786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb50b-22ad-4de2-86f3-1c51059defa0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:52.255279 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb50b-22ad-4de2-86f3-1c51059defa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.257216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb50b-22ad-4de2-86f3-1c51059defa0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.278579 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 477/964] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:52.285658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb50b-22ad-4de2-86f3-1c51059defa0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.294020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114f8d9-4071-4184-9cc6-7be34eb66aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.294679 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114f8d9-4071-4184-9cc6-7be34eb66aff None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.294965 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114f8d9-4071-4184-9cc6-7be34eb66aff None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.295234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114f8d9-4071-4184-9cc6-7be34eb66aff None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.295887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114f8d9-4071-4184-9cc6-7be34eb66aff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.297350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114f8d9-4071-4184-9cc6-7be34eb66aff None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.317723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:52.370444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 488/965] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:52 2022] POST /identity/v3/services => generated 242 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:52.372065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184ba7e-307e-465b-9397-1c2ce7409dca None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.372582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184ba7e-307e-465b-9397-1c2ce7409dca None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.373079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184ba7e-307e-465b-9397-1c2ce7409dca None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.374986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 489/966] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:52.381418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0b947-2b0c-452a-b50c-b1dc8cf94616 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.381826 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0b947-2b0c-452a-b50c-b1dc8cf94616 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.381998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0b947-2b0c-452a-b50c-b1dc8cf94616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.404299 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5df0b947-2b0c-452a-b50c-b1dc8cf94616 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:52.415658 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5df0b947-2b0c-452a-b50c-b1dc8cf94616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:52.415825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb50b-22ad-4de2-86f3-1c51059defa0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.473827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30d084-079e-4a4f-b78f-e5b1ec5f143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.474493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30d084-079e-4a4f-b78f-e5b1ec5f143d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.474778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30d084-079e-4a4f-b78f-e5b1ec5f143d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.475056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30d084-079e-4a4f-b78f-e5b1ec5f143d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.518961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 490/967] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:52.567674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30d084-079e-4a4f-b78f-e5b1ec5f143d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.569200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30d084-079e-4a4f-b78f-e5b1ec5f143d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.593154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:52.688298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 478/968] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:52 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:27:52.695696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0b947-2b0c-452a-b50c-b1dc8cf94616 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.746285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:52.814702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0b947-2b0c-452a-b50c-b1dc8cf94616 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.818587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30d084-079e-4a4f-b78f-e5b1ec5f143d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.855804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee4a41-62bb-4b02-8aca-4d24e72015b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.856612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee4a41-62bb-4b02-8aca-4d24e72015b2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.856909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee4a41-62bb-4b02-8aca-4d24e72015b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.857188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee4a41-62bb-4b02-8aca-4d24e72015b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.869642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee4a41-62bb-4b02-8aca-4d24e72015b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.871236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee4a41-62bb-4b02-8aca-4d24e72015b2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d8ee4a41-62bb-4b02-8aca-4d24e72015b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:52.890964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:52.892169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:52.893655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:52.893655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:52.893655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:52.893655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 491/969] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:52.898470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee4a41-62bb-4b02-8aca-4d24e72015b2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.965292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30d084-079e-4a4f-b78f-e5b1ec5f143d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.995253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.010687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386dc7-0e57-4fc8-a576-5d796f05d980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.012168 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386dc7-0e57-4fc8-a576-5d796f05d980 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.012842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386dc7-0e57-4fc8-a576-5d796f05d980 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.012973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.013576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386dc7-0e57-4fc8-a576-5d796f05d980 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.014632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be386dc7-0e57-4fc8-a576-5d796f05d980 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.016238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be386dc7-0e57-4fc8-a576-5d796f05d980 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-be386dc7-0e57-4fc8-a576-5d796f05d980 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:53.026685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:53.027807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:53.028770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:53.029544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee4a41-62bb-4b02-8aca-4d24e72015b2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.037487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 479/970] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:53.039429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386dc7-0e57-4fc8-a576-5d796f05d980 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.077869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2627c-5d26-4ce0-8501-74e2b96714eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.078639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2627c-5d26-4ce0-8501-74e2b96714eb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.078982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2627c-5d26-4ce0-8501-74e2b96714eb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.079321 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2627c-5d26-4ce0-8501-74e2b96714eb None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.080032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2627c-5d26-4ce0-8501-74e2b96714eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:53.080405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2627c-5d26-4ce0-8501-74e2b96714eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.082741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2627c-5d26-4ce0-8501-74e2b96714eb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.102224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 492/971] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:53.105971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2627c-5d26-4ce0-8501-74e2b96714eb None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.177063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386dc7-0e57-4fc8-a576-5d796f05d980 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.222082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2627c-5d26-4ce0-8501-74e2b96714eb None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.233751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545c79-86b1-420b-8c92-e6c0ad274d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.235472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545c79-86b1-420b-8c92-e6c0ad274d57 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.236015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545c79-86b1-420b-8c92-e6c0ad274d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.236446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545c79-86b1-420b-8c92-e6c0ad274d57 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.238321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64545c79-86b1-420b-8c92-e6c0ad274d57 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:53.238802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64545c79-86b1-420b-8c92-e6c0ad274d57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.241041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64545c79-86b1-420b-8c92-e6c0ad274d57 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.248103 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 480/972] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:53.254576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545c79-86b1-420b-8c92-e6c0ad274d57 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.267482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2b7ea-daf9-4743-816d-ac4f964f82f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.268168 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b7ea-daf9-4743-816d-ac4f964f82f9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.268491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b7ea-daf9-4743-816d-ac4f964f82f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.268753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b7ea-daf9-4743-816d-ac4f964f82f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.276088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2b7ea-daf9-4743-816d-ac4f964f82f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.277536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2b7ea-daf9-4743-816d-ac4f964f82f9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3ed2b7ea-daf9-4743-816d-ac4f964f82f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:53.289762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:53.290726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:53.291676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:53.291676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:53.291676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:53.291676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:53.291676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:53.291676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:53.291676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:53.291676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:53.294647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 493/973] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:53.297024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2b7ea-daf9-4743-816d-ac4f964f82f9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.311168 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.326388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.413710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545c79-86b1-420b-8c92-e6c0ad274d57 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.415419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2b7ea-daf9-4743-816d-ac4f964f82f9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.455169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e4b51-b0f1-42c2-8688-6c18da22d8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.456520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4b51-b0f1-42c2-8688-6c18da22d8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.456969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4b51-b0f1-42c2-8688-6c18da22d8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.457260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4b51-b0f1-42c2-8688-6c18da22d8b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.458027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e4b51-b0f1-42c2-8688-6c18da22d8b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:53.458399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e4b51-b0f1-42c2-8688-6c18da22d8b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.459871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510dd50-b3e2-46ca-a333-3475906a5928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.460003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e4b51-b0f1-42c2-8688-6c18da22d8b2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.460820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dd50-b3e2-46ca-a333-3475906a5928 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.461832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dd50-b3e2-46ca-a333-3475906a5928 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.462353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dd50-b3e2-46ca-a333-3475906a5928 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.463823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510dd50-b3e2-46ca-a333-3475906a5928 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:53.464346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510dd50-b3e2-46ca-a333-3475906a5928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.465926 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510dd50-b3e2-46ca-a333-3475906a5928 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.473375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 481/974] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:53.478854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510dd50-b3e2-46ca-a333-3475906a5928 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.479305 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 494/975] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:53.485318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e4b51-b0f1-42c2-8688-6c18da22d8b2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.569196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.592975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510dd50-b3e2-46ca-a333-3475906a5928 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.603991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e4b51-b0f1-42c2-8688-6c18da22d8b2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.607438 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.630154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e33202-abb1-4be1-bd45-9fe30a586d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.630796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e33202-abb1-4be1-bd45-9fe30a586d38 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.631093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e33202-abb1-4be1-bd45-9fe30a586d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.631353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e33202-abb1-4be1-bd45-9fe30a586d38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.632010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e33202-abb1-4be1-bd45-9fe30a586d38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.633384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e33202-abb1-4be1-bd45-9fe30a586d38 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.643490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e328e6f-f205-4c43-8a45-64c1fc0100f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.644145 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e328e6f-f205-4c43-8a45-64c1fc0100f9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.644460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e328e6f-f205-4c43-8a45-64c1fc0100f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.644713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e328e6f-f205-4c43-8a45-64c1fc0100f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.645443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e328e6f-f205-4c43-8a45-64c1fc0100f9 None admin] RBAC: Adding query filter params (role.id=3fd9779d8c3a49a1bb26d7bcd5c8ebff, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=be2fc683522941169708877bcfe2dc56) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:53.645758 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e328e6f-f205-4c43-8a45-64c1fc0100f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.647214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e328e6f-f205-4c43-8a45-64c1fc0100f9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.653006 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 495/976] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/role_assignments?user.id=be2fc683522941169708877bcfe2dc56&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=3fd9779d8c3a49a1bb26d7bcd5c8ebff => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:53.654265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e0631-36e3-4e6f-ac55-faa1c5e99711 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.654560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e0631-36e3-4e6f-ac55-faa1c5e99711 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.654928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e0631-36e3-4e6f-ac55-faa1c5e99711 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.660977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 496/977] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:53.662289 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83996d7-c8e0-4864-ab9d-ecb7481888a0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.662584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83996d7-c8e0-4864-ab9d-ecb7481888a0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.662867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83996d7-c8e0-4864-ab9d-ecb7481888a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.682714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a83996d7-c8e0-4864-ab9d-ecb7481888a0 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:53.683859 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a83996d7-c8e0-4864-ab9d-ecb7481888a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:53.732726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 482/978] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:53.775868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 497/979] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:54.053496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e33202-abb1-4be1-bd45-9fe30a586d38 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:54.163805 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e33202-abb1-4be1-bd45-9fe30a586d38 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:54.200908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:54.201529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.201811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.202087 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.202839 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:54.204325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.207580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WARNING keystone.server.flask.common [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 12:27:54.255365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.sql.core [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 12:27:54.255365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 12:27:54.255365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [parameters: {'user_id': 'bee2a36b571c42dc910c4f9d6ccaffa0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 12:27:54.255365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81822) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application result.read() Aug 22 12:27:54.262747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:27:54.263823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application yield resource Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise self.value Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application session.commit() Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 12:27:54.265036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self.session.flush() Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application compat.raise_( Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 12:27:54.266153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:27:54.267306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application result.read() Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:27:54.268899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bee2a36b571c42dc910c4f9d6ccaffa0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:54.270017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 12:27:54.271026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 12:27:54.272185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 12:27:54.272185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 12:27:54.272185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 12:27:54.272185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 12:27:54.272185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 12:27:54.272185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:54.272185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 483/980] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 22 12:27:54 2022] POST /identity/v3/users => generated 160 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:54.272749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83996d7-c8e0-4864-ab9d-ecb7481888a0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:54.334644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:54.376513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83996d7-c8e0-4864-ab9d-ecb7481888a0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:54.413509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e92cc-9cd1-4e56-9a6c-8c6f3edabd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:54.414137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e92cc-9cd1-4e56-9a6c-8c6f3edabd00 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.414449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e92cc-9cd1-4e56-9a6c-8c6f3edabd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.414724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e92cc-9cd1-4e56-9a6c-8c6f3edabd00 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.421932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e92cc-9cd1-4e56-9a6c-8c6f3edabd00 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:54.423464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e92cc-9cd1-4e56-9a6c-8c6f3edabd00 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-cb0e92cc-9cd1-4e56-9a6c-8c6f3edabd00 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:54.435595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:54.437599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:54.439734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 498/981] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:54.446226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:54.475979 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:54.477980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a133f-74b3-4670-b59b-55a7643c1b68 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.477980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a133f-74b3-4670-b59b-55a7643c1b68 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.477980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a133f-74b3-4670-b59b-55a7643c1b68 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.487603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 499/982] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:54.487603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0578b9-dfb4-4923-90a8-1fd526d8662d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.487603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0578b9-dfb4-4923-90a8-1fd526d8662d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.491151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0578b9-dfb4-4923-90a8-1fd526d8662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.508425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-db0578b9-dfb4-4923-90a8-1fd526d8662d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:54.509906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-db0578b9-dfb4-4923-90a8-1fd526d8662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:54.561247 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a135b9-f3ca-41c5-bdf0-45d6bb760c1d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:54.594309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 500/983] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:54.614716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e72f7-76ab-4bfb-800e-7cdf85c9abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:54.615322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e72f7-76ab-4bfb-800e-7cdf85c9abf0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.615600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e72f7-76ab-4bfb-800e-7cdf85c9abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.615924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e72f7-76ab-4bfb-800e-7cdf85c9abf0 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.616669 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e72f7-76ab-4bfb-800e-7cdf85c9abf0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:54.616968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e72f7-76ab-4bfb-800e-7cdf85c9abf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:54.618723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e72f7-76ab-4bfb-800e-7cdf85c9abf0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.657562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 484/984] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 22 12:27:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:54.874700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0578b9-dfb4-4923-90a8-1fd526d8662d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:54.929854 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:54.981625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0578b9-dfb4-4923-90a8-1fd526d8662d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:55.015999 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602de3f-9b9a-4b6e-8254-50675fc26fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:55.016637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602de3f-9b9a-4b6e-8254-50675fc26fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.016925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602de3f-9b9a-4b6e-8254-50675fc26fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.017206 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602de3f-9b9a-4b6e-8254-50675fc26fb0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.017792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602de3f-9b9a-4b6e-8254-50675fc26fb0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:55.019240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602de3f-9b9a-4b6e-8254-50675fc26fb0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6602de3f-9b9a-4b6e-8254-50675fc26fb0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:55.027835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:55.028843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:55.029705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:55.033846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 501/985] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:55.035210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e72f7-76ab-4bfb-800e-7cdf85c9abf0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:55.124605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:55.137494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e72f7-76ab-4bfb-800e-7cdf85c9abf0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:55.178491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ce91b-a26e-4c3b-8115-1953ee39afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:55.179759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ce91b-a26e-4c3b-8115-1953ee39afee None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.179759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ce91b-a26e-4c3b-8115-1953ee39afee None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.180069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ce91b-a26e-4c3b-8115-1953ee39afee None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.180648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ce91b-a26e-4c3b-8115-1953ee39afee None admin] RBAC: Adding query filter params (name=compute) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:55.180951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ce91b-a26e-4c3b-8115-1953ee39afee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:55.182364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ce91b-a26e-4c3b-8115-1953ee39afee None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:55.192675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 485/986] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:55.194269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602de3f-9b9a-4b6e-8254-50675fc26fb0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:55.297875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602de3f-9b9a-4b6e-8254-50675fc26fb0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:55.312271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:55.333462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c055c-c79b-4c1f-a1df-29ab69ed8c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:55.334070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c055c-c79b-4c1f-a1df-29ab69ed8c10 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.334386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c055c-c79b-4c1f-a1df-29ab69ed8c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.334665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c055c-c79b-4c1f-a1df-29ab69ed8c10 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.335340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c055c-c79b-4c1f-a1df-29ab69ed8c10 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:55.335647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c055c-c79b-4c1f-a1df-29ab69ed8c10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:55.337025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c055c-c79b-4c1f-a1df-29ab69ed8c10 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:55.348125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 502/987] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:55.349716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ce91b-a26e-4c3b-8115-1953ee39afee None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:55.450069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ce91b-a26e-4c3b-8115-1953ee39afee None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:55.484620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fd6b5-c5b2-4888-9a4d-8a8fbf5caed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:55.485227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fd6b5-c5b2-4888-9a4d-8a8fbf5caed9 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.485504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fd6b5-c5b2-4888-9a4d-8a8fbf5caed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.485775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fd6b5-c5b2-4888-9a4d-8a8fbf5caed9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.486493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fd6b5-c5b2-4888-9a4d-8a8fbf5caed9 None admin] RBAC: Adding query filter params (interface=public, service_id=811a19b232aa4aa4a0fa8751fa2806b5, region_id=RegionOne) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:55.486879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fd6b5-c5b2-4888-9a4d-8a8fbf5caed9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:55.488525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fd6b5-c5b2-4888-9a4d-8a8fbf5caed9 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:55.495956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 486/988] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:55 2022] GET /identity/v3/endpoints?service_id=811a19b232aa4aa4a0fa8751fa2806b5&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:55.501318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c055c-c79b-4c1f-a1df-29ab69ed8c10 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:55.605305 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c055c-c79b-4c1f-a1df-29ab69ed8c10 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:55.639674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ee9ae-6737-4b62-bc1c-6435b66e9916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:55.640300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ee9ae-6737-4b62-bc1c-6435b66e9916 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.640569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ee9ae-6737-4b62-bc1c-6435b66e9916 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.640844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ee9ae-6737-4b62-bc1c-6435b66e9916 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.641447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ee9ae-6737-4b62-bc1c-6435b66e9916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:55.642856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ee9ae-6737-4b62-bc1c-6435b66e9916 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:55.655494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 503/989] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:55 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:27:55.657654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e7ba1-6641-4b1e-bd6e-4d4e986f3bbf None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.657941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e7ba1-6641-4b1e-bd6e-4d4e986f3bbf None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.658239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e7ba1-6641-4b1e-bd6e-4d4e986f3bbf None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.660634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 487/990] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:55.666636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957faaf6-6724-43d0-8332-467590f331ea None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.666946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957faaf6-6724-43d0-8332-467590f331ea None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.667209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957faaf6-6724-43d0-8332-467590f331ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.686960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-957faaf6-6724-43d0-8332-467590f331ea None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:55.688196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-957faaf6-6724-43d0-8332-467590f331ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:55.730324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:55.764919 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 504/991] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:55.786633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac3536-24fe-4377-98a5-67c8e8ceedee None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.786987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac3536-24fe-4377-98a5-67c8e8ceedee None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.787175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac3536-24fe-4377-98a5-67c8e8ceedee None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.788684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 488/992] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:55.794213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f153-2071-4d05-8797-7d40f32ab3ed None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.794521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f153-2071-4d05-8797-7d40f32ab3ed None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.794800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f153-2071-4d05-8797-7d40f32ab3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.816405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-de55f153-2071-4d05-8797-7d40f32ab3ed None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:55.817838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-de55f153-2071-4d05-8797-7d40f32ab3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:55.887738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 505/993] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:56.038257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac3536-24fe-4377-98a5-67c8e8ceedee None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.057035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:56.144536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac3536-24fe-4377-98a5-67c8e8ceedee None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.158832 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55f153-2071-4d05-8797-7d40f32ab3ed None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.183565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3bfe9-5fe8-4f0b-8bf4-3b3a773d53eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.184208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3bfe9-5fe8-4f0b-8bf4-3b3a773d53eb None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.184647 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3bfe9-5fe8-4f0b-8bf4-3b3a773d53eb None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.184928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3bfe9-5fe8-4f0b-8bf4-3b3a773d53eb None admin] PATH_INFO: `/v3/services/image` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.185504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3bfe9-5fe8-4f0b-8bf4-3b3a773d53eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.186907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3bfe9-5fe8-4f0b-8bf4-3b3a773d53eb None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-25c3bfe9-5fe8-4f0b-8bf4-3b3a773d53eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:56.197240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:56.198296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:56.199164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 489/994] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:56.204036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3bfe9-5fe8-4f0b-8bf4-3b3a773d53eb None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.275848 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55f153-2071-4d05-8797-7d40f32ab3ed None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.277746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:56.289758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:56.308430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3bfe9-5fe8-4f0b-8bf4-3b3a773d53eb None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.310716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028383a4-eed2-45fe-bd3d-bf513f554b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.311357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028383a4-eed2-45fe-bd3d-bf513f554b75 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.311637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028383a4-eed2-45fe-bd3d-bf513f554b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.311909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028383a4-eed2-45fe-bd3d-bf513f554b75 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.312488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028383a4-eed2-45fe-bd3d-bf513f554b75 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.314128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028383a4-eed2-45fe-bd3d-bf513f554b75 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-028383a4-eed2-45fe-bd3d-bf513f554b75 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:56.324079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:56.325340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:56.326417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 506/995] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:56.331796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028383a4-eed2-45fe-bd3d-bf513f554b75 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.349311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bcbfe-29b5-453f-a871-c880563c4524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.349921 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bcbfe-29b5-453f-a871-c880563c4524 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.350512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bcbfe-29b5-453f-a871-c880563c4524 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.350512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bcbfe-29b5-453f-a871-c880563c4524 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.351125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bcbfe-29b5-453f-a871-c880563c4524 None admin] RBAC: Adding query filter params (name=image) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:56.351433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bcbfe-29b5-453f-a871-c880563c4524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.352825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bcbfe-29b5-453f-a871-c880563c4524 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.357426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 490/996] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:56.363023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bcbfe-29b5-453f-a871-c880563c4524 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.437934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028383a4-eed2-45fe-bd3d-bf513f554b75 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.462032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bcbfe-29b5-453f-a871-c880563c4524 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.474840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278e2a3-a6da-49b8-9817-636abf971cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.475698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278e2a3-a6da-49b8-9817-636abf971cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.476186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278e2a3-a6da-49b8-9817-636abf971cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.476714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278e2a3-a6da-49b8-9817-636abf971cb3 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.477500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278e2a3-a6da-49b8-9817-636abf971cb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:56.477983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278e2a3-a6da-49b8-9817-636abf971cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.479707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278e2a3-a6da-49b8-9817-636abf971cb3 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.484893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 507/997] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:56.491780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278e2a3-a6da-49b8-9817-636abf971cb3 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.496387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed0423-e0fc-499c-b678-8839ad03900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.496995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed0423-e0fc-499c-b678-8839ad03900b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.497278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed0423-e0fc-499c-b678-8839ad03900b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.497552 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed0423-e0fc-499c-b678-8839ad03900b None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.498184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed0423-e0fc-499c-b678-8839ad03900b None admin] RBAC: Adding query filter params (type=image) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:56.498511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed0423-e0fc-499c-b678-8839ad03900b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.499903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed0423-e0fc-499c-b678-8839ad03900b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.504534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 491/998] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:56.541324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:56.618694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278e2a3-a6da-49b8-9817-636abf971cb3 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.657530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82158957-af84-4d1c-9dcc-d358f3e74c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.658150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82158957-af84-4d1c-9dcc-d358f3e74c7e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.658531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82158957-af84-4d1c-9dcc-d358f3e74c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.659384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82158957-af84-4d1c-9dcc-d358f3e74c7e None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.660027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82158957-af84-4d1c-9dcc-d358f3e74c7e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:56.660326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82158957-af84-4d1c-9dcc-d358f3e74c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.661703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82158957-af84-4d1c-9dcc-d358f3e74c7e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.667051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 508/999] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:56.673455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed0423-e0fc-499c-b678-8839ad03900b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.685077 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:56.778601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed0423-e0fc-499c-b678-8839ad03900b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.813427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b802ac-bae4-4dea-90f3-a48e05d6f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.814031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b802ac-bae4-4dea-90f3-a48e05d6f8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.814344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b802ac-bae4-4dea-90f3-a48e05d6f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.814616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b802ac-bae4-4dea-90f3-a48e05d6f8c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.816051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b802ac-bae4-4dea-90f3-a48e05d6f8c7 None admin] RBAC: Adding query filter params (interface=admin, service_id=8dd1c31b35d54bc48d006cce4c5e903b, region_id=RegionOne) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:56.816413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b802ac-bae4-4dea-90f3-a48e05d6f8c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.817770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b802ac-bae4-4dea-90f3-a48e05d6f8c7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.827420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 492/1000] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/endpoints?service_id=8dd1c31b35d54bc48d006cce4c5e903b&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:56.828612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82158957-af84-4d1c-9dcc-d358f3e74c7e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.925711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:56.933265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82158957-af84-4d1c-9dcc-d358f3e74c7e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.970104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e691fd-7a7e-47bd-9e98-e4e0fc8b224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.970781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e691fd-7a7e-47bd-9e98-e4e0fc8b224f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.971100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e691fd-7a7e-47bd-9e98-e4e0fc8b224f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.971558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e691fd-7a7e-47bd-9e98-e4e0fc8b224f None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.972223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e691fd-7a7e-47bd-9e98-e4e0fc8b224f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.973604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e691fd-7a7e-47bd-9e98-e4e0fc8b224f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.986453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 509/1001] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:27:57.598861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba9669-82e5-4306-bfdb-f935d6f7e781 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:57.599429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba9669-82e5-4306-bfdb-f935d6f7e781 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:57.599429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba9669-82e5-4306-bfdb-f935d6f7e781 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:57.600812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 493/1002] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:57.607120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a711555-e0b0-4428-a25a-3b35a7abb9d8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:57.607441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a711555-e0b0-4428-a25a-3b35a7abb9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:57.607690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a711555-e0b0-4428-a25a-3b35a7abb9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:57.625714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0a711555-e0b0-4428-a25a-3b35a7abb9d8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:57.626933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0a711555-e0b0-4428-a25a-3b35a7abb9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:57.695559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 510/1003] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:57.971354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba9669-82e5-4306-bfdb-f935d6f7e781 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:58.045598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:58.078984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba9669-82e5-4306-bfdb-f935d6f7e781 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:58.113186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c9eda-2ce8-45bf-a65d-99d5043121f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:58.113817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c9eda-2ce8-45bf-a65d-99d5043121f7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.114100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c9eda-2ce8-45bf-a65d-99d5043121f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.114401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c9eda-2ce8-45bf-a65d-99d5043121f7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.114986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c9eda-2ce8-45bf-a65d-99d5043121f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:58.116343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c9eda-2ce8-45bf-a65d-99d5043121f7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-246c9eda-2ce8-45bf-a65d-99d5043121f7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:58.124934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:58.125988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:58.126903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:27:58.131477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 494/1004] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:58.132869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a711555-e0b0-4428-a25a-3b35a7abb9d8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:58.228421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:58.240418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a711555-e0b0-4428-a25a-3b35a7abb9d8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:58.274331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b13c14-0461-4d47-8b47-2d60671a5483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:58.274952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b13c14-0461-4d47-8b47-2d60671a5483 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.275239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b13c14-0461-4d47-8b47-2d60671a5483 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.275521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b13c14-0461-4d47-8b47-2d60671a5483 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.276155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b13c14-0461-4d47-8b47-2d60671a5483 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:58.276466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b13c14-0461-4d47-8b47-2d60671a5483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:58.277852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b13c14-0461-4d47-8b47-2d60671a5483 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:58.287519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 511/1005] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:58.289098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c9eda-2ce8-45bf-a65d-99d5043121f7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:58.394523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c9eda-2ce8-45bf-a65d-99d5043121f7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:58.429295 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ffc41-70e0-4cda-8f11-4d432e75e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:58.429910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ffc41-70e0-4cda-8f11-4d432e75e3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.430210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ffc41-70e0-4cda-8f11-4d432e75e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.430494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ffc41-70e0-4cda-8f11-4d432e75e3f7 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.431117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ffc41-70e0-4cda-8f11-4d432e75e3f7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:58.431423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ffc41-70e0-4cda-8f11-4d432e75e3f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:58.432785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ffc41-70e0-4cda-8f11-4d432e75e3f7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:58.434910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:58.443773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 495/1006] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:58.445156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b13c14-0461-4d47-8b47-2d60671a5483 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:58.447373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0745fb-fc8d-4384-81d9-82112e5f11d9 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.447874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0745fb-fc8d-4384-81d9-82112e5f11d9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.448500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0745fb-fc8d-4384-81d9-82112e5f11d9 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.451180 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 496/1007] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:58.456079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e4d75-80e1-4042-93da-dd7b4b23b4fa None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.456967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e4d75-80e1-4042-93da-dd7b4b23b4fa None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.457427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e4d75-80e1-4042-93da-dd7b4b23b4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.484974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-2a7e4d75-80e1-4042-93da-dd7b4b23b4fa None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:58.486454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2a7e4d75-80e1-4042-93da-dd7b4b23b4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:58.551604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b13c14-0461-4d47-8b47-2d60671a5483 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:58.573955 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 497/1008] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:58.587998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0cac7-95cc-4e07-b509-79979dc8c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:58.588614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0cac7-95cc-4e07-b509-79979dc8c5fd None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.588901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0cac7-95cc-4e07-b509-79979dc8c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.589178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0cac7-95cc-4e07-b509-79979dc8c5fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.589837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0cac7-95cc-4e07-b509-79979dc8c5fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:58.591240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0cac7-95cc-4e07-b509-79979dc8c5fd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:58.686232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 512/1009] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:58.847900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e4d75-80e1-4042-93da-dd7b4b23b4fa None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:58.871949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139f6ce-38a4-4d50-be3b-08633defa0cf None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.872278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139f6ce-38a4-4d50-be3b-08633defa0cf None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.872515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139f6ce-38a4-4d50-be3b-08633defa0cf None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.873869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 513/1010] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:58.880204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a88e20-4f24-444b-b4f3-e00d3198cbde None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.880489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a88e20-4f24-444b-b4f3-e00d3198cbde None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.880782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a88e20-4f24-444b-b4f3-e00d3198cbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.899634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-18a88e20-4f24-444b-b4f3-e00d3198cbde None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:58.900837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-18a88e20-4f24-444b-b4f3-e00d3198cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:58.902994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:58.959327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e4d75-80e1-4042-93da-dd7b4b23b4fa None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:58.982978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 514/1011] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:58 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:58.994305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:58.999987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c431f-80bb-4929-9fbe-0cc76ec2055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:59.000599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c431f-80bb-4929-9fbe-0cc76ec2055f None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:59.000876 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c431f-80bb-4929-9fbe-0cc76ec2055f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:59.001147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c431f-80bb-4929-9fbe-0cc76ec2055f None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:59.006245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c431f-80bb-4929-9fbe-0cc76ec2055f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:59.006245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c431f-80bb-4929-9fbe-0cc76ec2055f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:59.107214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 498/1012] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:58 2022] POST /identity/v3/services => generated 242 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:59.254300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a88e20-4f24-444b-b4f3-e00d3198cbde None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:59.357721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a88e20-4f24-444b-b4f3-e00d3198cbde None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:59.392517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:59.399209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f2c19-9539-49c8-8ecc-7b4da5cc20d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:59.399848 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f2c19-9539-49c8-8ecc-7b4da5cc20d7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:59.404516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f2c19-9539-49c8-8ecc-7b4da5cc20d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:59.404516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f2c19-9539-49c8-8ecc-7b4da5cc20d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:59.404516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f2c19-9539-49c8-8ecc-7b4da5cc20d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:59.404516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f2c19-9539-49c8-8ecc-7b4da5cc20d7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-ea4f2c19-9539-49c8-8ecc-7b4da5cc20d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:59.412044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:59.413050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:27:59.414345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 515/1013] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:59.419419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c431f-80bb-4929-9fbe-0cc76ec2055f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:59.524366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c431f-80bb-4929-9fbe-0cc76ec2055f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:59.558159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abc615-e8e6-43ff-b24f-a346c54df50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:59.558794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abc615-e8e6-43ff-b24f-a346c54df50d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:59.559074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abc615-e8e6-43ff-b24f-a346c54df50d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:59.559348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abc615-e8e6-43ff-b24f-a346c54df50d None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:59.559968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abc615-e8e6-43ff-b24f-a346c54df50d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:59.560269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abc615-e8e6-43ff-b24f-a346c54df50d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:59.561629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abc615-e8e6-43ff-b24f-a346c54df50d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:59.572300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 499/1014] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:59.573493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f2c19-9539-49c8-8ecc-7b4da5cc20d7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:59.694122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f2c19-9539-49c8-8ecc-7b4da5cc20d7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:59.727091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61339caa-e5b2-4e94-abb6-f967057ae3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:59.727905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61339caa-e5b2-4e94-abb6-f967057ae3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:59.728368 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61339caa-e5b2-4e94-abb6-f967057ae3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:59.728801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61339caa-e5b2-4e94-abb6-f967057ae3a2 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:59.729583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61339caa-e5b2-4e94-abb6-f967057ae3a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:59.730056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61339caa-e5b2-4e94-abb6-f967057ae3a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:59.731680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61339caa-e5b2-4e94-abb6-f967057ae3a2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:59.742049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 516/1015] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:59.743358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abc615-e8e6-43ff-b24f-a346c54df50d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:59.802899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:59.850105 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abc615-e8e6-43ff-b24f-a346c54df50d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:59.885776 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80902308-01a2-4673-9e7b-d6936ad0125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:59.886443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80902308-01a2-4673-9e7b-d6936ad0125a None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:59.886730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80902308-01a2-4673-9e7b-d6936ad0125a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:59.887008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80902308-01a2-4673-9e7b-d6936ad0125a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:59.887765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80902308-01a2-4673-9e7b-d6936ad0125a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:59.889236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80902308-01a2-4673-9e7b-d6936ad0125a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:59.955824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 500/1016] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:28:00.718418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794cedb-e0eb-43a8-bbfe-82af73a42630 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:00.718944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794cedb-e0eb-43a8-bbfe-82af73a42630 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:00.718944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794cedb-e0eb-43a8-bbfe-82af73a42630 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:00.720348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 517/1017] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:00.725592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c2a32-4e82-4c1f-8608-e565d78f53bf None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:00.725882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c2a32-4e82-4c1f-8608-e565d78f53bf None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:00.726159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c2a32-4e82-4c1f-8608-e565d78f53bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:00.745042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-702c2a32-4e82-4c1f-8608-e565d78f53bf None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:00.746287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-702c2a32-4e82-4c1f-8608-e565d78f53bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:00.822980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 501/1018] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:01.046249 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce26b8-f16a-4d3a-9aca-9fa1c7904ea4 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.046458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce26b8-f16a-4d3a-9aca-9fa1c7904ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.046718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce26b8-f16a-4d3a-9aca-9fa1c7904ea4 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.048298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 518/1019] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:01.054420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa89a60-36b3-4b31-9844-aaacea021039 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.054941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa89a60-36b3-4b31-9844-aaacea021039 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.055022 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa89a60-36b3-4b31-9844-aaacea021039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.073140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-9fa89a60-36b3-4b31-9844-aaacea021039 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:01.074365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9fa89a60-36b3-4b31-9844-aaacea021039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:01.094201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce26b8-f16a-4d3a-9aca-9fa1c7904ea4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:01.109607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:01.144290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 502/1020] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:01.160501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:01.212802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce26b8-f16a-4d3a-9aca-9fa1c7904ea4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:01.260237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8100cfe-be52-492a-99e4-726113511218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:01.260237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8100cfe-be52-492a-99e4-726113511218 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.260237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8100cfe-be52-492a-99e4-726113511218 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.260237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8100cfe-be52-492a-99e4-726113511218 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.277158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8100cfe-be52-492a-99e4-726113511218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-a8100cfe-be52-492a-99e4-726113511218 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:01.281941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:01.282942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:01.284398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:01.285767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 519/1021] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 22 12:28:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:01.289911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa89a60-36b3-4b31-9844-aaacea021039 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:01.394632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa89a60-36b3-4b31-9844-aaacea021039 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:01.422979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8100cfe-be52-492a-99e4-726113511218 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:01.429364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0e50-696c-4d52-8e11-2260afcea87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:01.429980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0e50-696c-4d52-8e11-2260afcea87c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.430292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0e50-696c-4d52-8e11-2260afcea87c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.430572 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0e50-696c-4d52-8e11-2260afcea87c None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.431249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c0e50-696c-4d52-8e11-2260afcea87c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:01.431554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c0e50-696c-4d52-8e11-2260afcea87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:01.432923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c0e50-696c-4d52-8e11-2260afcea87c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:01.448051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 503/1022] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 22 12:28:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:01.449567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0e50-696c-4d52-8e11-2260afcea87c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:01.485375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:01.543574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8100cfe-be52-492a-99e4-726113511218 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:01.565037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:01.568621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0e50-696c-4d52-8e11-2260afcea87c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:01.584128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c222f9-4e27-4b9c-9106-f20ec33470bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:01.585066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c222f9-4e27-4b9c-9106-f20ec33470bb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.585570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c222f9-4e27-4b9c-9106-f20ec33470bb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.586128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c222f9-4e27-4b9c-9106-f20ec33470bb None admin] PATH_INFO: `/v3/services/image` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.587045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c222f9-4e27-4b9c-9106-f20ec33470bb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:01.588834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c222f9-4e27-4b9c-9106-f20ec33470bb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-09c222f9-4e27-4b9c-9106-f20ec33470bb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:01.599383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:01.600546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:01.601629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:01.603905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 520/1023] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Aug 22 12:28:01 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:01.607607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11e988-253d-4478-a9f7-b713f8777a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:01.608281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11e988-253d-4478-a9f7-b713f8777a0c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.608567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11e988-253d-4478-a9f7-b713f8777a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.608844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11e988-253d-4478-a9f7-b713f8777a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.610558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c222f9-4e27-4b9c-9106-f20ec33470bb None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:01.621336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11e988-253d-4478-a9f7-b713f8777a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:01.622837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11e988-253d-4478-a9f7-b713f8777a0c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-5d11e988-253d-4478-a9f7-b713f8777a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:01.637381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:01.638462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:01.639420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:01.639420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:01.639420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:01.643859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 504/1024] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:01.644865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11e988-253d-4478-a9f7-b713f8777a0c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:01.727807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c222f9-4e27-4b9c-9106-f20ec33470bb None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:01.756567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:01.763970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42906129-8f88-40db-8c96-ade2167db410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:01.764627 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42906129-8f88-40db-8c96-ade2167db410 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.764915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42906129-8f88-40db-8c96-ade2167db410 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.769815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42906129-8f88-40db-8c96-ade2167db410 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.769815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42906129-8f88-40db-8c96-ade2167db410 None admin] RBAC: Adding query filter params (name=image) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:01.769815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42906129-8f88-40db-8c96-ade2167db410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:01.769815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42906129-8f88-40db-8c96-ade2167db410 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:01.778335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 521/1025] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:01.779213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42906129-8f88-40db-8c96-ade2167db410 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:01.780132 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11e988-253d-4478-a9f7-b713f8777a0c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:01.819486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac8fc5-0ec6-4b5a-97c4-1683d53c267c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:01.820103 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac8fc5-0ec6-4b5a-97c4-1683d53c267c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.820387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac8fc5-0ec6-4b5a-97c4-1683d53c267c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.820664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac8fc5-0ec6-4b5a-97c4-1683d53c267c None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.821308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac8fc5-0ec6-4b5a-97c4-1683d53c267c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:01.821616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac8fc5-0ec6-4b5a-97c4-1683d53c267c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:01.823037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac8fc5-0ec6-4b5a-97c4-1683d53c267c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:01.832539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:01.836661 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 505/1026] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:01.842319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac8fc5-0ec6-4b5a-97c4-1683d53c267c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:01.897329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42906129-8f88-40db-8c96-ade2167db410 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:01.939591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c220a5-a7e0-4535-ba9c-a77cd2c11f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:01.940779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c220a5-a7e0-4535-ba9c-a77cd2c11f82 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.941066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c220a5-a7e0-4535-ba9c-a77cd2c11f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.941343 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c220a5-a7e0-4535-ba9c-a77cd2c11f82 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.941977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c220a5-a7e0-4535-ba9c-a77cd2c11f82 None admin] RBAC: Adding query filter params (type=image) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:01.942316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c220a5-a7e0-4535-ba9c-a77cd2c11f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:01.943703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c220a5-a7e0-4535-ba9c-a77cd2c11f82 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:01.948665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 522/1027] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:01.950146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3887-029a-4299-a893-e8fcb1171fec None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.950146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3887-029a-4299-a893-e8fcb1171fec None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.950438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3887-029a-4299-a893-e8fcb1171fec None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.951781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 523/1028] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:01.955013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3887-029a-4299-a893-e8fcb1171fec None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:01.962452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac8fc5-0ec6-4b5a-97c4-1683d53c267c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:01.997432 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45189987-8d38-4e39-afc7-9d0c3f10e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:01.998053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45189987-8d38-4e39-afc7-9d0c3f10e15c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.998371 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45189987-8d38-4e39-afc7-9d0c3f10e15c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.998642 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45189987-8d38-4e39-afc7-9d0c3f10e15c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.005964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45189987-8d38-4e39-afc7-9d0c3f10e15c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:02.007421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45189987-8d38-4e39-afc7-9d0c3f10e15c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-45189987-8d38-4e39-afc7-9d0c3f10e15c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:28:02.023531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:02.024801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:02.025785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 506/1029] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 22 12:28:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:02.026919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763686e0-9a66-4e96-9181-30861ad65832 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.026919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763686e0-9a66-4e96-9181-30861ad65832 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.026919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763686e0-9a66-4e96-9181-30861ad65832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.033185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:02.045060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-763686e0-9a66-4e96-9181-30861ad65832 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:02.046262 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-763686e0-9a66-4e96-9181-30861ad65832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:02.061580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3887-029a-4299-a893-e8fcb1171fec None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:02.073398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:02.098401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5eaf-f114-4dc2-860a-e041187cda92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:02.101118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5eaf-f114-4dc2-860a-e041187cda92 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.101118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5eaf-f114-4dc2-860a-e041187cda92 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.101118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5eaf-f114-4dc2-860a-e041187cda92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.101118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab5eaf-f114-4dc2-860a-e041187cda92 None admin] RBAC: Adding query filter params (interface=public, service_id=db32641369244a5c8345419a6dec3e32, region_id=RegionOne) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:02.101118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab5eaf-f114-4dc2-860a-e041187cda92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:02.102042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab5eaf-f114-4dc2-860a-e041187cda92 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:02.111967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 524/1030] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 22 12:28:01 2022] GET /identity/v3/endpoints?service_id=db32641369244a5c8345419a6dec3e32&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:02.111967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5eaf-f114-4dc2-860a-e041187cda92 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:02.125583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 507/1031] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:02.126473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763686e0-9a66-4e96-9181-30861ad65832 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:02.230692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5eaf-f114-4dc2-860a-e041187cda92 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:02.250542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763686e0-9a66-4e96-9181-30861ad65832 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:02.272580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fe6ed-dd4c-434f-a125-efff6c8ac4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:02.273201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fe6ed-dd4c-434f-a125-efff6c8ac4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.273491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fe6ed-dd4c-434f-a125-efff6c8ac4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.273771 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fe6ed-dd4c-434f-a125-efff6c8ac4c2 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.274546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fe6ed-dd4c-434f-a125-efff6c8ac4c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:02.274884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fe6ed-dd4c-434f-a125-efff6c8ac4c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:02.276308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fe6ed-dd4c-434f-a125-efff6c8ac4c2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:02.288901 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e934e-60eb-4f52-8df4-4b312b75ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:02.290369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e934e-60eb-4f52-8df4-4b312b75ed0b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.291111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e934e-60eb-4f52-8df4-4b312b75ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.291840 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e934e-60eb-4f52-8df4-4b312b75ed0b None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.292946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e934e-60eb-4f52-8df4-4b312b75ed0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:02.294755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e934e-60eb-4f52-8df4-4b312b75ed0b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:02.295666 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 525/1032] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 22 12:28:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:02.296202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:02.302331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fe6ed-dd4c-434f-a125-efff6c8ac4c2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:02.308301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 508/1033] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 22 12:28:02 2022] GET /identity/v3/services => generated 1957 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:28:02.342485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:02.423397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fe6ed-dd4c-434f-a125-efff6c8ac4c2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:02.461251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506419a-9fca-4d35-80bc-7898080742b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:02.461797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506419a-9fca-4d35-80bc-7898080742b2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.462089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506419a-9fca-4d35-80bc-7898080742b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.462410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506419a-9fca-4d35-80bc-7898080742b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.465618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e934e-60eb-4f52-8df4-4b312b75ed0b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:02.556105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506419a-9fca-4d35-80bc-7898080742b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:02.558714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506419a-9fca-4d35-80bc-7898080742b2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:02.595253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e934e-60eb-4f52-8df4-4b312b75ed0b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:02.599851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:02.636636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1844449-dcd1-4c7f-8f8b-e717f536662c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:02.637590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1844449-dcd1-4c7f-8f8b-e717f536662c None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.638230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1844449-dcd1-4c7f-8f8b-e717f536662c None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.638517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1844449-dcd1-4c7f-8f8b-e717f536662c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.639624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1844449-dcd1-4c7f-8f8b-e717f536662c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:02.641287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1844449-dcd1-4c7f-8f8b-e717f536662c None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:02.643751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 509/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:02.650474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1844449-dcd1-4c7f-8f8b-e717f536662c None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:02.682030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 526/1035] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:28:02.687664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506419a-9fca-4d35-80bc-7898080742b2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:02.732034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:02.770569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1844449-dcd1-4c7f-8f8b-e717f536662c None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:02.797264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506419a-9fca-4d35-80bc-7898080742b2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:02.810236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3616-ad78-4f39-9aa3-51fd65526788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:02.810236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3616-ad78-4f39-9aa3-51fd65526788 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.810236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3616-ad78-4f39-9aa3-51fd65526788 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.810236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3616-ad78-4f39-9aa3-51fd65526788 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.810644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e3616-ad78-4f39-9aa3-51fd65526788 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:02.811587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e3616-ad78-4f39-9aa3-51fd65526788 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:02.830014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:02.834901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81333b-b8ba-46d4-979b-04269f80d478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:02.835543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81333b-b8ba-46d4-979b-04269f80d478 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.835830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81333b-b8ba-46d4-979b-04269f80d478 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.836107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81333b-b8ba-46d4-979b-04269f80d478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.846828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81333b-b8ba-46d4-979b-04269f80d478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:02.848280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81333b-b8ba-46d4-979b-04269f80d478 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-af81333b-b8ba-46d4-979b-04269f80d478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:02.863413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:02.864448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:02.865802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:02.865802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:02.865802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:02.865802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 527/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:02.871080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81333b-b8ba-46d4-979b-04269f80d478 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:02.892188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 510/1037] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:28:02 2022] POST /identity/v3/projects => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:28:02.986118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81333b-b8ba-46d4-979b-04269f80d478 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.022961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0c8b-640f-4978-ad9b-270d50deaec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.023594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0c8b-640f-4978-ad9b-270d50deaec5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.023886 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0c8b-640f-4978-ad9b-270d50deaec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.024238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0c8b-640f-4978-ad9b-270d50deaec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.024901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0c8b-640f-4978-ad9b-270d50deaec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:03.025212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0c8b-640f-4978-ad9b-270d50deaec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:03.026763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0c8b-640f-4978-ad9b-270d50deaec5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:03.045045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 528/1038] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:03.046715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3616-ad78-4f39-9aa3-51fd65526788 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:03.181443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3616-ad78-4f39-9aa3-51fd65526788 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.200414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:03.218404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14672e2b-c2bc-405c-ad32-033807dd5164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.220703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14672e2b-c2bc-405c-ad32-033807dd5164 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.220703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14672e2b-c2bc-405c-ad32-033807dd5164 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.220703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14672e2b-c2bc-405c-ad32-033807dd5164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.226814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14672e2b-c2bc-405c-ad32-033807dd5164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:03.228320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14672e2b-c2bc-405c-ad32-033807dd5164 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-14672e2b-c2bc-405c-ad32-033807dd5164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:28:03.240900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:03.241991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:03.243151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:28:03.243151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:28:03.243151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:28:03.243151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:28:03.243151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:28:03.243151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:28:03.243151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:03.243151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:03.249901 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 511/1039] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:28:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:03.251219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0c8b-640f-4978-ad9b-270d50deaec5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:03.301562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:03.364365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0c8b-640f-4978-ad9b-270d50deaec5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.406511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab38a0-598b-4917-a125-a838e9cf436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.407355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab38a0-598b-4917-a125-a838e9cf436f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.407742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab38a0-598b-4917-a125-a838e9cf436f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.408119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab38a0-598b-4917-a125-a838e9cf436f None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.409688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab38a0-598b-4917-a125-a838e9cf436f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:03.410119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab38a0-598b-4917-a125-a838e9cf436f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:03.412227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab38a0-598b-4917-a125-a838e9cf436f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:03.430013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 529/1040] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:28:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:03.435953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14672e2b-c2bc-405c-ad32-033807dd5164 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:03.542824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14672e2b-c2bc-405c-ad32-033807dd5164 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.576904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aeac4e-bb46-4221-9542-7c9a2cd8d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.577507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeac4e-bb46-4221-9542-7c9a2cd8d104 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.577786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeac4e-bb46-4221-9542-7c9a2cd8d104 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.578059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeac4e-bb46-4221-9542-7c9a2cd8d104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.578813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aeac4e-bb46-4221-9542-7c9a2cd8d104 None admin] RBAC: Adding query filter params (role.id=3fd9779d8c3a49a1bb26d7bcd5c8ebff, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=9e2f71ebeca2441791a0241de737cad0) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:03.579123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aeac4e-bb46-4221-9542-7c9a2cd8d104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:03.581080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aeac4e-bb46-4221-9542-7c9a2cd8d104 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:03.586905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 512/1041] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:03 2022] GET /identity/v3/role_assignments?user.id=9e2f71ebeca2441791a0241de737cad0&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=3fd9779d8c3a49a1bb26d7bcd5c8ebff => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:04.331701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27744-a8f8-4ebb-a89a-5d7705c85871 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.332214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27744-a8f8-4ebb-a89a-5d7705c85871 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.332294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27744-a8f8-4ebb-a89a-5d7705c85871 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.333748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 530/1042] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:04.338995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213780-d989-4a24-8be1-d960fa0e71c2 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.339406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213780-d989-4a24-8be1-d960fa0e71c2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.339573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213780-d989-4a24-8be1-d960fa0e71c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.358541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-de213780-d989-4a24-8be1-d960fa0e71c2 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:04.359734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-de213780-d989-4a24-8be1-d960fa0e71c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:04.399259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:04.435075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 513/1043] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:04.721480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b27744-a8f8-4ebb-a89a-5d7705c85871 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:04.831333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b27744-a8f8-4ebb-a89a-5d7705c85871 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:04.833661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:04.867077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbd2e2-1dc3-4491-8b8d-dfdaa7efe983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:04.867714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbd2e2-1dc3-4491-8b8d-dfdaa7efe983 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.867998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbd2e2-1dc3-4491-8b8d-dfdaa7efe983 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.868273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbd2e2-1dc3-4491-8b8d-dfdaa7efe983 None admin] PATH_INFO: `/v3/services/image` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.868856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbd2e2-1dc3-4491-8b8d-dfdaa7efe983 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:04.870258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbd2e2-1dc3-4491-8b8d-dfdaa7efe983 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-e7dbd2e2-1dc3-4491-8b8d-dfdaa7efe983 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:04.880167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:04.881165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:04.882142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:04.887034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 531/1044] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Aug 22 12:28:04 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:04.888455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213780-d989-4a24-8be1-d960fa0e71c2 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:04.927686 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790517fe-7c4d-4794-a4e7-f1696c0d0931 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.928002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790517fe-7c4d-4794-a4e7-f1696c0d0931 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.928272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790517fe-7c4d-4794-a4e7-f1696c0d0931 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.929804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 532/1045] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:28:04.935022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ace2-b9c8-4915-b3ab-945812ff7f1a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.935309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ace2-b9c8-4915-b3ab-945812ff7f1a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.935584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ace2-b9c8-4915-b3ab-945812ff7f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.954234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c992ace2-b9c8-4915-b3ab-945812ff7f1a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:04.955970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c992ace2-b9c8-4915-b3ab-945812ff7f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:05.002696 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213780-d989-4a24-8be1-d960fa0e71c2 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.034394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 533/1046] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:28:05.041527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442229c-f480-4bdb-9f8c-eba8f658e0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.042140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442229c-f480-4bdb-9f8c-eba8f658e0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.042454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442229c-f480-4bdb-9f8c-eba8f658e0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.042730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442229c-f480-4bdb-9f8c-eba8f658e0c3 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.043427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442229c-f480-4bdb-9f8c-eba8f658e0c3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:05.043732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442229c-f480-4bdb-9f8c-eba8f658e0c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.045087 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442229c-f480-4bdb-9f8c-eba8f658e0c3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.050815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 514/1047] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:05.057061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992ace2-b9c8-4915-b3ab-945812ff7f1a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.167706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.175047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992ace2-b9c8-4915-b3ab-945812ff7f1a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.211552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580b815-a1a3-4e6d-bcb2-66754044f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.212194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580b815-a1a3-4e6d-bcb2-66754044f516 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.212482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580b815-a1a3-4e6d-bcb2-66754044f516 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.212760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580b815-a1a3-4e6d-bcb2-66754044f516 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.213390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580b815-a1a3-4e6d-bcb2-66754044f516 None admin] RBAC: Adding query filter params (type=image) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:05.213700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580b815-a1a3-4e6d-bcb2-66754044f516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.215130 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580b815-a1a3-4e6d-bcb2-66754044f516 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.225069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 534/1048] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:05.227250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442229c-f480-4bdb-9f8c-eba8f658e0c3 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.266734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.320516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580b815-a1a3-4e6d-bcb2-66754044f516 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.349427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442229c-f480-4bdb-9f8c-eba8f658e0c3 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.391830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4cc00-8e22-4d2c-a6b6-950be927ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.394310 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4cc00-8e22-4d2c-a6b6-950be927ad17 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.395074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4cc00-8e22-4d2c-a6b6-950be927ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.395558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4cc00-8e22-4d2c-a6b6-950be927ad17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.396656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4cc00-8e22-4d2c-a6b6-950be927ad17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.398814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4cc00-8e22-4d2c-a6b6-950be927ad17 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.444478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580b815-a1a3-4e6d-bcb2-66754044f516 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.479409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653e2e5-e1fb-4cfb-8654-4566822f4ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.480042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e2e5-e1fb-4cfb-8654-4566822f4ecb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.480326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e2e5-e1fb-4cfb-8654-4566822f4ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.480601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e2e5-e1fb-4cfb-8654-4566822f4ecb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.481697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653e2e5-e1fb-4cfb-8654-4566822f4ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.483214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653e2e5-e1fb-4cfb-8654-4566822f4ecb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.484956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 535/1049] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:05.491630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653e2e5-e1fb-4cfb-8654-4566822f4ecb None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.518423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 515/1050] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:28:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:05.530375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.652821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653e2e5-e1fb-4cfb-8654-4566822f4ecb None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.701517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2edb-62ee-476b-81c0-3ec3df1be5b3 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.702419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2edb-62ee-476b-81c0-3ec3df1be5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.702712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2edb-62ee-476b-81c0-3ec3df1be5b3 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.704795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 516/1051] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:28:05.708513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c3914-5372-435b-89f0-7dbc53c32e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.709226 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3914-5372-435b-89f0-7dbc53c32e9b None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.709512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3914-5372-435b-89f0-7dbc53c32e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.709787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3914-5372-435b-89f0-7dbc53c32e9b None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.710471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c3914-5372-435b-89f0-7dbc53c32e9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.711208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc505e-7b61-4d22-9e6f-034638d7ab67 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.711691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc505e-7b61-4d22-9e6f-034638d7ab67 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.711923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c3914-5372-435b-89f0-7dbc53c32e9b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.712039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc505e-7b61-4d22-9e6f-034638d7ab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.731712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-84fc505e-7b61-4d22-9e6f-034638d7ab67 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:05.735626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-84fc505e-7b61-4d22-9e6f-034638d7ab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:05.789924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 536/1052] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:28:05 2022] POST /identity/v3/users => generated 285 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:28:05.805283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 517/1053] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:06.077071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c3914-5372-435b-89f0-7dbc53c32e9b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:06.165035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:06.191153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c3914-5372-435b-89f0-7dbc53c32e9b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.227775 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e52cbd-f3c5-4af8-8be9-653b250be43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.228416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52cbd-f3c5-4af8-8be9-653b250be43e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.228703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52cbd-f3c5-4af8-8be9-653b250be43e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.228982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52cbd-f3c5-4af8-8be9-653b250be43e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.240407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e52cbd-f3c5-4af8-8be9-653b250be43e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c4e52cbd-f3c5-4af8-8be9-653b250be43e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:06.245156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:06.246100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:06.247036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 537/1054] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 22 12:28:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:06.254424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc505e-7b61-4d22-9e6f-034638d7ab67 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:06.279020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:06.358292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc505e-7b61-4d22-9e6f-034638d7ab67 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.394419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285fb09-ffc1-4c7a-b49a-a70accacc2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.395380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285fb09-ffc1-4c7a-b49a-a70accacc2ca None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.395934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285fb09-ffc1-4c7a-b49a-a70accacc2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.396492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285fb09-ffc1-4c7a-b49a-a70accacc2ca None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.397354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285fb09-ffc1-4c7a-b49a-a70accacc2ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:06.397879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285fb09-ffc1-4c7a-b49a-a70accacc2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:06.399464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285fb09-ffc1-4c7a-b49a-a70accacc2ca None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:06.408337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 518/1055] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 22 12:28:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:06.413773 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e52cbd-f3c5-4af8-8be9-653b250be43e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:06.519789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e52cbd-f3c5-4af8-8be9-653b250be43e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.556944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9572a-a2e1-4548-b6dd-fe4c0cfdd54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.557583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9572a-a2e1-4548-b6dd-fe4c0cfdd54c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.557870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9572a-a2e1-4548-b6dd-fe4c0cfdd54c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.558150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9572a-a2e1-4548-b6dd-fe4c0cfdd54c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.570915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9572a-a2e1-4548-b6dd-fe4c0cfdd54c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:06.572379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9572a-a2e1-4548-b6dd-fe4c0cfdd54c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:06.574269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f4f9572a-a2e1-4548-b6dd-fe4c0cfdd54c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:06.597454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:06.599314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:06.600889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:06.600889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:06.600889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:06.602626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 538/1056] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:06.609033 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285fb09-ffc1-4c7a-b49a-a70accacc2ca None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:06.699424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:06.715264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285fb09-ffc1-4c7a-b49a-a70accacc2ca None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.750554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77aa00-6bdc-4d1b-96db-ef80643535ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.751166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77aa00-6bdc-4d1b-96db-ef80643535ab None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.751441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77aa00-6bdc-4d1b-96db-ef80643535ab None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.751714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77aa00-6bdc-4d1b-96db-ef80643535ab None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.752487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77aa00-6bdc-4d1b-96db-ef80643535ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:06.752791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77aa00-6bdc-4d1b-96db-ef80643535ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:06.754144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77aa00-6bdc-4d1b-96db-ef80643535ab None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:06.770397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 519/1057] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:06.771834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9572a-a2e1-4548-b6dd-fe4c0cfdd54c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:06.876958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9572a-a2e1-4548-b6dd-fe4c0cfdd54c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.913134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983588d0-ad21-45b1-a94f-0735958cee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.913774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983588d0-ad21-45b1-a94f-0735958cee3a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.914058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983588d0-ad21-45b1-a94f-0735958cee3a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.914359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983588d0-ad21-45b1-a94f-0735958cee3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.922651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983588d0-ad21-45b1-a94f-0735958cee3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:06.924671 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983588d0-ad21-45b1-a94f-0735958cee3a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-983588d0-ad21-45b1-a94f-0735958cee3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:28:06.936552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:06.937624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:06.939075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 539/1058] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 22 12:28:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:06.944362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77aa00-6bdc-4d1b-96db-ef80643535ab None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:07.052814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77aa00-6bdc-4d1b-96db-ef80643535ab None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:07.087937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806ac42-723b-4d42-8576-665f147132b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:07.088551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806ac42-723b-4d42-8576-665f147132b6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.088834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806ac42-723b-4d42-8576-665f147132b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.089107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806ac42-723b-4d42-8576-665f147132b6 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.089838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806ac42-723b-4d42-8576-665f147132b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:07.090146 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806ac42-723b-4d42-8576-665f147132b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:07.091616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806ac42-723b-4d42-8576-665f147132b6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:07.111933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 520/1059] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 22 12:28:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:07.115347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983588d0-ad21-45b1-a94f-0735958cee3a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:07.182862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:07.225679 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983588d0-ad21-45b1-a94f-0735958cee3a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:07.270256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783af88-7227-4ff3-a9d3-f507eb70834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:07.270900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783af88-7227-4ff3-a9d3-f507eb70834b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.271181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783af88-7227-4ff3-a9d3-f507eb70834b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.271452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783af88-7227-4ff3-a9d3-f507eb70834b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.282468 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783af88-7227-4ff3-a9d3-f507eb70834b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:07.284016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783af88-7227-4ff3-a9d3-f507eb70834b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-4783af88-7227-4ff3-a9d3-f507eb70834b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:07.298394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:07.300629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:07.301552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:07.301552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:07.301552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:07.301552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 540/1060] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:07.307912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806ac42-723b-4d42-8576-665f147132b6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:07.310785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:07.411974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806ac42-723b-4d42-8576-665f147132b6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:07.447358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99623ad2-e554-455e-be30-76d86fb185d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:07.447890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623ad2-e554-455e-be30-76d86fb185d0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.448172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623ad2-e554-455e-be30-76d86fb185d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.448447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623ad2-e554-455e-be30-76d86fb185d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.449086 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99623ad2-e554-455e-be30-76d86fb185d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:07.449390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99623ad2-e554-455e-be30-76d86fb185d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:07.450781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99623ad2-e554-455e-be30-76d86fb185d0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:07.467196 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 521/1061] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:07.468640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783af88-7227-4ff3-a9d3-f507eb70834b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:07.528053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584ae7-2712-4e3d-8a4c-cff2f4da2c2c None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.528673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584ae7-2712-4e3d-8a4c-cff2f4da2c2c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.528959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584ae7-2712-4e3d-8a4c-cff2f4da2c2c None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.530586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 522/1062] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:07.535980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da9a6-f633-4510-bc2d-e4139e16b9e7 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.536275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da9a6-f633-4510-bc2d-e4139e16b9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.536562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da9a6-f633-4510-bc2d-e4139e16b9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.555602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-d87da9a6-f633-4510-bc2d-e4139e16b9e7 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:07.556816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d87da9a6-f633-4510-bc2d-e4139e16b9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:07.588150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783af88-7227-4ff3-a9d3-f507eb70834b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:07.599300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:07.621831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:07.624703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a392aba-d5c2-4d62-a793-5a14582c30cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:07.625353 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a392aba-d5c2-4d62-a793-5a14582c30cc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.625639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a392aba-d5c2-4d62-a793-5a14582c30cc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.625913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a392aba-d5c2-4d62-a793-5a14582c30cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.632660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a392aba-d5c2-4d62-a793-5a14582c30cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:07.634253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a392aba-d5c2-4d62-a793-5a14582c30cc None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:07.642581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 523/1063] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-0a392aba-d5c2-4d62-a793-5a14582c30cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:28:07.647379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:07.648326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:07.651202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:28:07.651202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:28:07.651202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:28:07.651202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:28:07.651202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:28:07.651202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:28:07.651202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:07.651202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:07.651202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 541/1064] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:28:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:07.654477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da9a6-f633-4510-bc2d-e4139e16b9e7 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:07.760685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da9a6-f633-4510-bc2d-e4139e16b9e7 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:07.788514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145425d-77fb-49a0-a998-2fa31df48055 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.789166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145425d-77fb-49a0-a998-2fa31df48055 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.789513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145425d-77fb-49a0-a998-2fa31df48055 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.791016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 542/1065] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:28:07.795819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf97e9f-0b0b-4978-adc3-92b4256b3824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:07.795952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56dce0-d744-4f12-9f33-5f6f0d55e52a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.796230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56dce0-d744-4f12-9f33-5f6f0d55e52a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.796429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf97e9f-0b0b-4978-adc3-92b4256b3824 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.796529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56dce0-d744-4f12-9f33-5f6f0d55e52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.796707 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf97e9f-0b0b-4978-adc3-92b4256b3824 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.796980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf97e9f-0b0b-4978-adc3-92b4256b3824 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.797670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf97e9f-0b0b-4978-adc3-92b4256b3824 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:07.797977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf97e9f-0b0b-4978-adc3-92b4256b3824 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:07.800122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf97e9f-0b0b-4978-adc3-92b4256b3824 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:07.818045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 524/1066] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:07.818933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1c56dce0-d744-4f12-9f33-5f6f0d55e52a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:07.818933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1c56dce0-d744-4f12-9f33-5f6f0d55e52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:07.819570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf97e9f-0b0b-4978-adc3-92b4256b3824 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:07.875502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:07.888236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 543/1067] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:28:07.909567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56dce0-d744-4f12-9f33-5f6f0d55e52a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:07.929942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf97e9f-0b0b-4978-adc3-92b4256b3824 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:07.967002 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a88300-b9ee-4718-b87d-6ac12091aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:07.967659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a88300-b9ee-4718-b87d-6ac12091aead None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.967942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a88300-b9ee-4718-b87d-6ac12091aead None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.968220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a88300-b9ee-4718-b87d-6ac12091aead None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/9e2f71ebeca2441791a0241de737cad0/roles/3fd9779d8c3a49a1bb26d7bcd5c8ebff` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.970594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a88300-b9ee-4718-b87d-6ac12091aead None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=9e2f71ebeca2441791a0241de737cad0, role_id=3fd9779d8c3a49a1bb26d7bcd5c8ebff)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:07.972610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a88300-b9ee-4718-b87d-6ac12091aead None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.010467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.016230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56dce0-d744-4f12-9f33-5f6f0d55e52a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.050389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 525/1068] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:28:07 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/9e2f71ebeca2441791a0241de737cad0/roles/3fd9779d8c3a49a1bb26d7bcd5c8ebff => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:28:08.052513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07f53e-5233-47a0-ad2c-3a1536ba5bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.053155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07f53e-5233-47a0-ad2c-3a1536ba5bad None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.053438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07f53e-5233-47a0-ad2c-3a1536ba5bad None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.053714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07f53e-5233-47a0-ad2c-3a1536ba5bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.131859 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07f53e-5233-47a0-ad2c-3a1536ba5bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.133452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07f53e-5233-47a0-ad2c-3a1536ba5bad None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.155511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a88300-b9ee-4718-b87d-6ac12091aead None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.251391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.259200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 544/1069] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:28:08.265992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07f53e-5233-47a0-ad2c-3a1536ba5bad None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.285674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a88300-b9ee-4718-b87d-6ac12091aead None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.300649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.322078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7198a6-2f9e-467c-9254-68153bb72e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.323158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7198a6-2f9e-467c-9254-68153bb72e53 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.323445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7198a6-2f9e-467c-9254-68153bb72e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.323869 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7198a6-2f9e-467c-9254-68153bb72e53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.335286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7198a6-2f9e-467c-9254-68153bb72e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-7d7198a6-2f9e-467c-9254-68153bb72e53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:08.340081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:08.343064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:08.344027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 526/1070] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:08.348317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7198a6-2f9e-467c-9254-68153bb72e53 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.381936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07f53e-5233-47a0-ad2c-3a1536ba5bad None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.419921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2162ac6-dba8-49ed-bcc8-27f6e421d5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.420571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2162ac6-dba8-49ed-bcc8-27f6e421d5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.420833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2162ac6-dba8-49ed-bcc8-27f6e421d5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.421111 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2162ac6-dba8-49ed-bcc8-27f6e421d5d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.432379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2162ac6-dba8-49ed-bcc8-27f6e421d5d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.433902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2162ac6-dba8-49ed-bcc8-27f6e421d5d7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b2162ac6-dba8-49ed-bcc8-27f6e421d5d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:08.449912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:08.450957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:08.451884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:08.451884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:08.451884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:08.451884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 545/1071] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:08.457264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2162ac6-dba8-49ed-bcc8-27f6e421d5d7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.458466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7198a6-2f9e-467c-9254-68153bb72e53 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.497363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ee912-79ff-4c08-a7b0-5a1a1d3740f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.498245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ee912-79ff-4c08-a7b0-5a1a1d3740f3 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.498397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ee912-79ff-4c08-a7b0-5a1a1d3740f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.498608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ee912-79ff-4c08-a7b0-5a1a1d3740f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.499366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ee912-79ff-4c08-a7b0-5a1a1d3740f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:08.499672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ee912-79ff-4c08-a7b0-5a1a1d3740f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.501476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ee912-79ff-4c08-a7b0-5a1a1d3740f3 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.511339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.514763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 527/1072] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:08.520181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ee912-79ff-4c08-a7b0-5a1a1d3740f3 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.561861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.566555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2162ac6-dba8-49ed-bcc8-27f6e421d5d7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.601378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837882db-a408-46e7-81eb-352ca249e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.602012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837882db-a408-46e7-81eb-352ca249e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.602307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837882db-a408-46e7-81eb-352ca249e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.602588 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837882db-a408-46e7-81eb-352ca249e9d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.603240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837882db-a408-46e7-81eb-352ca249e9d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:08.603552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837882db-a408-46e7-81eb-352ca249e9d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.605040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837882db-a408-46e7-81eb-352ca249e9d0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.618164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 546/1073] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:08.641205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ee912-79ff-4c08-a7b0-5a1a1d3740f3 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.687349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489265b-b510-477f-a7c8-ef979158acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.688263 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489265b-b510-477f-a7c8-ef979158acc8 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.688718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489265b-b510-477f-a7c8-ef979158acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.689126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489265b-b510-477f-a7c8-ef979158acc8 None admin] PATH_INFO: `/v3/users/2e87f254111a4e80a66b74591588fd1e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.709404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489265b-b510-477f-a7c8-ef979158acc8 None admin] RBAC: Authorizing `identity:get_user(user_id=2e87f254111a4e80a66b74591588fd1e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.711018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489265b-b510-477f-a7c8-ef979158acc8 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.712748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 528/1074] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/users/2e87f254111a4e80a66b74591588fd1e => generated 285 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:08.718779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837882db-a408-46e7-81eb-352ca249e9d0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.827862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837882db-a408-46e7-81eb-352ca249e9d0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.841345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.865858 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906535-8d8e-4008-825e-c14e1d878c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.866505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906535-8d8e-4008-825e-c14e1d878c78 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.866791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906535-8d8e-4008-825e-c14e1d878c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.867068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906535-8d8e-4008-825e-c14e1d878c78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.936500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906535-8d8e-4008-825e-c14e1d878c78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.937964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906535-8d8e-4008-825e-c14e1d878c78 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.038498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 547/1075] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:28:09.044295 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489265b-b510-477f-a7c8-ef979158acc8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.134470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:09.142662 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489265b-b510-477f-a7c8-ef979158acc8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.182567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10343bb6-34ed-4d24-a221-7e8c6d86c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.183205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343bb6-34ed-4d24-a221-7e8c6d86c7ca None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.183486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343bb6-34ed-4d24-a221-7e8c6d86c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.183820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343bb6-34ed-4d24-a221-7e8c6d86c7ca None admin] PATH_INFO: `/v3/projects/35bdc5293d244656ac8568c90a49f13f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.184938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10343bb6-34ed-4d24-a221-7e8c6d86c7ca None admin] RBAC: Authorizing `identity:get_project(project_id=35bdc5293d244656ac8568c90a49f13f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.186395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10343bb6-34ed-4d24-a221-7e8c6d86c7ca None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.188023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 529/1076] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/projects/35bdc5293d244656ac8568c90a49f13f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:09.194482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906535-8d8e-4008-825e-c14e1d878c78 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.204657 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:09.292012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906535-8d8e-4008-825e-c14e1d878c78 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.324662 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f28fc2-1d21-45f9-8056-0aaff2df3100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.325260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f28fc2-1d21-45f9-8056-0aaff2df3100 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.325540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f28fc2-1d21-45f9-8056-0aaff2df3100 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.325814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f28fc2-1d21-45f9-8056-0aaff2df3100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.326567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f28fc2-1d21-45f9-8056-0aaff2df3100 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=35bdc5293d244656ac8568c90a49f13f, user.id=2e87f254111a4e80a66b74591588fd1e) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:09.326877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f28fc2-1d21-45f9-8056-0aaff2df3100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.328310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f28fc2-1d21-45f9-8056-0aaff2df3100 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.334345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 548/1077] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/role_assignments?user.id=2e87f254111a4e80a66b74591588fd1e&scope.project.id=35bdc5293d244656ac8568c90a49f13f&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:10.007411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d3c21-b1fb-457b-9ff2-6919d6b271f1 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:10.007968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d3c21-b1fb-457b-9ff2-6919d6b271f1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:10.007968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d3c21-b1fb-457b-9ff2-6919d6b271f1 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:10.009296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 530/1078] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:10.014746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8019dde-70a8-4e4e-b451-d72cc2dae231 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:10.015138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8019dde-70a8-4e4e-b451-d72cc2dae231 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:10.015301 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8019dde-70a8-4e4e-b451-d72cc2dae231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:10.034359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e8019dde-70a8-4e4e-b451-d72cc2dae231 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:10.035545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e8019dde-70a8-4e4e-b451-d72cc2dae231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:10.099931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 549/1079] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:10.373611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d3c21-b1fb-457b-9ff2-6919d6b271f1 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:10.475319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d3c21-b1fb-457b-9ff2-6919d6b271f1 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:10.508917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb844-64ff-4d9b-a01f-e784cc1dc195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:10.509538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb844-64ff-4d9b-a01f-e784cc1dc195 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:10.509817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb844-64ff-4d9b-a01f-e784cc1dc195 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:10.510090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb844-64ff-4d9b-a01f-e784cc1dc195 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:10.520136 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb844-64ff-4d9b-a01f-e784cc1dc195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-c76bb844-64ff-4d9b-a01f-e784cc1dc195 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:10.524747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:10.525792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:10.526705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:10.530353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 531/1080] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 22 12:28:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:10.531803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8019dde-70a8-4e4e-b451-d72cc2dae231 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:10.535123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:10.632423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8019dde-70a8-4e4e-b451-d72cc2dae231 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:10.666061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ba9d0-8420-4058-91d7-e7fdf486fefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:10.666768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ba9d0-8420-4058-91d7-e7fdf486fefd None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:10.667056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ba9d0-8420-4058-91d7-e7fdf486fefd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:10.667336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ba9d0-8420-4058-91d7-e7fdf486fefd None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:10.668000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ba9d0-8420-4058-91d7-e7fdf486fefd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:10.668310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ba9d0-8420-4058-91d7-e7fdf486fefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:10.669690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ba9d0-8420-4058-91d7-e7fdf486fefd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:10.677677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 550/1081] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 22 12:28:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:10.683406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb844-64ff-4d9b-a01f-e784cc1dc195 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:10.706433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:10.782015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb844-64ff-4d9b-a01f-e784cc1dc195 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:10.815227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f70c-f3f7-4892-b029-ee7992ed8c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:10.816099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f70c-f3f7-4892-b029-ee7992ed8c5e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:10.816377 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f70c-f3f7-4892-b029-ee7992ed8c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:10.816649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f70c-f3f7-4892-b029-ee7992ed8c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:10.826676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2f70c-f3f7-4892-b029-ee7992ed8c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:10.828109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2f70c-f3f7-4892-b029-ee7992ed8c5e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-48c2f70c-f3f7-4892-b029-ee7992ed8c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:10.842614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:10.843744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:10.844655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:10.844655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:10.844655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:10.844655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 532/1082] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:10.850265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ba9d0-8420-4058-91d7-e7fdf486fefd None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:10.911351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:10.947968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ba9d0-8420-4058-91d7-e7fdf486fefd None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:10.981243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cd6ad-b7c1-403d-902f-7ecb34aa56fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:10.981847 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd6ad-b7c1-403d-902f-7ecb34aa56fd None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:10.982126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd6ad-b7c1-403d-902f-7ecb34aa56fd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:10.982425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd6ad-b7c1-403d-902f-7ecb34aa56fd None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:10.983061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cd6ad-b7c1-403d-902f-7ecb34aa56fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:10.983363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cd6ad-b7c1-403d-902f-7ecb34aa56fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:10.984730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cd6ad-b7c1-403d-902f-7ecb34aa56fd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:10.996802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 551/1083] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:11.002620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f70c-f3f7-4892-b029-ee7992ed8c5e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.071159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:11.101710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f70c-f3f7-4892-b029-ee7992ed8c5e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:11.135806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fa6a9-2049-46b3-97c4-227a9a4f64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:11.136436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fa6a9-2049-46b3-97c4-227a9a4f64b1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.136718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fa6a9-2049-46b3-97c4-227a9a4f64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.136991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fa6a9-2049-46b3-97c4-227a9a4f64b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.145034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fa6a9-2049-46b3-97c4-227a9a4f64b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:11.146527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fa6a9-2049-46b3-97c4-227a9a4f64b1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-181fa6a9-2049-46b3-97c4-227a9a4f64b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:28:11.157363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:11.158396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:11.159785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 533/1084] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:11.164617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cd6ad-b7c1-403d-902f-7ecb34aa56fd None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.203145 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6ea38-8cb9-4ccb-a443-068148eabe0d None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.203436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6ea38-8cb9-4ccb-a443-068148eabe0d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.203717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6ea38-8cb9-4ccb-a443-068148eabe0d None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.205771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 534/1085] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:28:11.210754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c5d7-6949-45c5-97be-418a9176d44b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.211039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c5d7-6949-45c5-97be-418a9176d44b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.211314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c5d7-6949-45c5-97be-418a9176d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.229691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-efe6c5d7-6949-45c5-97be-418a9176d44b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:11.230903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-efe6c5d7-6949-45c5-97be-418a9176d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:11.264796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cd6ad-b7c1-403d-902f-7ecb34aa56fd None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:11.289580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:11.296420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 535/1086] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:28:11.300200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be5ff-f270-4fee-ad8f-0e6d112da9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:11.300810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be5ff-f270-4fee-ad8f-0e6d112da9af None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.301087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be5ff-f270-4fee-ad8f-0e6d112da9af None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.301356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be5ff-f270-4fee-ad8f-0e6d112da9af None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.302065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784be5ff-f270-4fee-ad8f-0e6d112da9af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:11.302436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784be5ff-f270-4fee-ad8f-0e6d112da9af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:11.303868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784be5ff-f270-4fee-ad8f-0e6d112da9af None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:11.322090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 552/1087] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:11.327343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c5d7-6949-45c5-97be-418a9176d44b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.390153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:11.427881 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c5d7-6949-45c5-97be-418a9176d44b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:11.462518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a818a90-888a-4264-85c0-268ba1f7ea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:11.463118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a818a90-888a-4264-85c0-268ba1f7ea35 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.463396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a818a90-888a-4264-85c0-268ba1f7ea35 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.463667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a818a90-888a-4264-85c0-268ba1f7ea35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.530002 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a818a90-888a-4264-85c0-268ba1f7ea35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:11.531556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a818a90-888a-4264-85c0-268ba1f7ea35 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:11.568044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be5ff-f270-4fee-ad8f-0e6d112da9af None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.591365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:11.631966 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 536/1088] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:11.637691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a818a90-888a-4264-85c0-268ba1f7ea35 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.667117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be5ff-f270-4fee-ad8f-0e6d112da9af None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:11.702451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c71a48-d4aa-4601-85c7-23e97f2e5117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:11.703007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c71a48-d4aa-4601-85c7-23e97f2e5117 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.703282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c71a48-d4aa-4601-85c7-23e97f2e5117 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.703555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c71a48-d4aa-4601-85c7-23e97f2e5117 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.713700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c71a48-d4aa-4601-85c7-23e97f2e5117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-85c71a48-d4aa-4601-85c7-23e97f2e5117 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:11.718399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:11.719557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:11.720661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 553/1089] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:11.725607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c71a48-d4aa-4601-85c7-23e97f2e5117 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.740078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a818a90-888a-4264-85c0-268ba1f7ea35 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:11.769753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:11.774855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd906aa-6cff-4349-ace1-ae8510c81e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:11.775477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd906aa-6cff-4349-ace1-ae8510c81e74 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.775756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd906aa-6cff-4349-ace1-ae8510c81e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.776027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd906aa-6cff-4349-ace1-ae8510c81e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.786136 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd906aa-6cff-4349-ace1-ae8510c81e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:11.787580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd906aa-6cff-4349-ace1-ae8510c81e74 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-8bd906aa-6cff-4349-ace1-ae8510c81e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:11.802305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:11.806977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:11.807914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:11.807914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:11.807914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:11.807914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 537/1090] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:11.809052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd906aa-6cff-4349-ace1-ae8510c81e74 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.824910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:11.827877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c71a48-d4aa-4601-85c7-23e97f2e5117 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:11.862252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be54419-3b04-457c-9440-70a07a67df65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:11.862882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be54419-3b04-457c-9440-70a07a67df65 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.863163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be54419-3b04-457c-9440-70a07a67df65 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.863435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be54419-3b04-457c-9440-70a07a67df65 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.864105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be54419-3b04-457c-9440-70a07a67df65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:11.864413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be54419-3b04-457c-9440-70a07a67df65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:11.865779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be54419-3b04-457c-9440-70a07a67df65 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:11.873555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 554/1091] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:11.879810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be54419-3b04-457c-9440-70a07a67df65 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.910354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd906aa-6cff-4349-ace1-ae8510c81e74 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:11.944003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0911221-554d-46c8-a8be-7078c6b2103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:11.944611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0911221-554d-46c8-a8be-7078c6b2103d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.944894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0911221-554d-46c8-a8be-7078c6b2103d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.945175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0911221-554d-46c8-a8be-7078c6b2103d None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.945809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0911221-554d-46c8-a8be-7078c6b2103d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:11.946116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0911221-554d-46c8-a8be-7078c6b2103d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:11.947528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0911221-554d-46c8-a8be-7078c6b2103d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:11.961457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 538/1092] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:11.967085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0911221-554d-46c8-a8be-7078c6b2103d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.982983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be54419-3b04-457c-9440-70a07a67df65 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:11.985432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:12.017030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b26dad-4d02-43c8-960f-5eaafd9e1915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.018507 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b26dad-4d02-43c8-960f-5eaafd9e1915 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.019063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b26dad-4d02-43c8-960f-5eaafd9e1915 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.019335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b26dad-4d02-43c8-960f-5eaafd9e1915 None admin] PATH_INFO: `/v3/users/2e87f254111a4e80a66b74591588fd1e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.020485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b26dad-4d02-43c8-960f-5eaafd9e1915 None admin] RBAC: Authorizing `identity:get_user(user_id=2e87f254111a4e80a66b74591588fd1e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.021922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b26dad-4d02-43c8-960f-5eaafd9e1915 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.028023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 555/1093] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/users/2e87f254111a4e80a66b74591588fd1e => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:12.029185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b26dad-4d02-43c8-960f-5eaafd9e1915 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.046620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:12.073461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0911221-554d-46c8-a8be-7078c6b2103d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.106888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad213-20e2-4bc0-9a70-3b704f7e6a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.107515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad213-20e2-4bc0-9a70-3b704f7e6a54 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.107793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad213-20e2-4bc0-9a70-3b704f7e6a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.108068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad213-20e2-4bc0-9a70-3b704f7e6a54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.115269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ad213-20e2-4bc0-9a70-3b704f7e6a54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.116516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ad213-20e2-4bc0-9a70-3b704f7e6a54 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-d67ad213-20e2-4bc0-9a70-3b704f7e6a54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:28:12.128846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:12.129909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:12.130892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:28:12.130892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:28:12.130892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:28:12.130892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:28:12.130892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:28:12.130892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:28:12.130892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:12.130892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:12.130892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 539/1094] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:12.135012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b26dad-4d02-43c8-960f-5eaafd9e1915 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.135800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad213-20e2-4bc0-9a70-3b704f7e6a54 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.169450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ef68d-e8d8-40f1-a9cb-7304375b3269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.170090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ef68d-e8d8-40f1-a9cb-7304375b3269 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.170404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ef68d-e8d8-40f1-a9cb-7304375b3269 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.170686 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ef68d-e8d8-40f1-a9cb-7304375b3269 None admin] PATH_INFO: `/v3/projects/35bdc5293d244656ac8568c90a49f13f` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.174921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ef68d-e8d8-40f1-a9cb-7304375b3269 None admin] RBAC: Authorizing `identity:get_project(project_id=35bdc5293d244656ac8568c90a49f13f)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.176813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ef68d-e8d8-40f1-a9cb-7304375b3269 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.178749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 556/1095] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:12 2022] GET /identity/v3/projects/35bdc5293d244656ac8568c90a49f13f => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:12.184272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ef68d-e8d8-40f1-a9cb-7304375b3269 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.227630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:12.239102 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad213-20e2-4bc0-9a70-3b704f7e6a54 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.273985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99e0ae-30b5-4e77-b9df-b6c1244d1412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.274618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e0ae-30b5-4e77-b9df-b6c1244d1412 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.274900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e0ae-30b5-4e77-b9df-b6c1244d1412 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.275232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e0ae-30b5-4e77-b9df-b6c1244d1412 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.275919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99e0ae-30b5-4e77-b9df-b6c1244d1412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:12.276278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99e0ae-30b5-4e77-b9df-b6c1244d1412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.277706 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99e0ae-30b5-4e77-b9df-b6c1244d1412 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.279273 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:12.284830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ef68d-e8d8-40f1-a9cb-7304375b3269 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.289956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 540/1096] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:12.296198 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99e0ae-30b5-4e77-b9df-b6c1244d1412 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.319722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37948-fa24-43f6-9948-cf55eefe5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.320377 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37948-fa24-43f6-9948-cf55eefe5f9b None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.320655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37948-fa24-43f6-9948-cf55eefe5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.320929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37948-fa24-43f6-9948-cf55eefe5f9b None admin] PATH_INFO: `/v3/projects/35bdc5293d244656ac8568c90a49f13f/users/2e87f254111a4e80a66b74591588fd1e/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.322829 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b37948-fa24-43f6-9948-cf55eefe5f9b None admin] RBAC: Authorizing `identity:create_grant(project_id=35bdc5293d244656ac8568c90a49f13f, user_id=2e87f254111a4e80a66b74591588fd1e, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.324262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b37948-fa24-43f6-9948-cf55eefe5f9b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.394538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99e0ae-30b5-4e77-b9df-b6c1244d1412 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.406301 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 557/1097] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:28:12 2022] PUT /identity/v3/projects/35bdc5293d244656ac8568c90a49f13f/users/2e87f254111a4e80a66b74591588fd1e/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:28:12.432880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95782f-0847-4877-8a74-546814a0e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.433518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95782f-0847-4877-8a74-546814a0e474 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.433796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95782f-0847-4877-8a74-546814a0e474 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.434072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95782f-0847-4877-8a74-546814a0e474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.434844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95782f-0847-4877-8a74-546814a0e474 None admin] RBAC: Adding query filter params (role.id=3fd9779d8c3a49a1bb26d7bcd5c8ebff, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=9e2f71ebeca2441791a0241de737cad0) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:12.435158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95782f-0847-4877-8a74-546814a0e474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.436628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95782f-0847-4877-8a74-546814a0e474 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.444102 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 541/1098] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:12 2022] GET /identity/v3/role_assignments?user.id=9e2f71ebeca2441791a0241de737cad0&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=3fd9779d8c3a49a1bb26d7bcd5c8ebff => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:14.308132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c425c30-fe60-4589-b941-8434cbc7ea2f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:14.308676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c425c30-fe60-4589-b941-8434cbc7ea2f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:14.308676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c425c30-fe60-4589-b941-8434cbc7ea2f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:14.310059 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 558/1099] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:14.315737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a83a89-c15f-4713-9f21-702dc10d0dd7 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:14.316139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a83a89-c15f-4713-9f21-702dc10d0dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:14.316286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a83a89-c15f-4713-9f21-702dc10d0dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:14.334051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c4a83a89-c15f-4713-9f21-702dc10d0dd7 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:14.335246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c4a83a89-c15f-4713-9f21-702dc10d0dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:14.386236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:14.398889 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 542/1100] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:14.677080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c425c30-fe60-4589-b941-8434cbc7ea2f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:14.854936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:14.858712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c425c30-fe60-4589-b941-8434cbc7ea2f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:14.891691 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484a8a-ba5f-42b6-80bf-8cb4cea6f828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:14.892904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484a8a-ba5f-42b6-80bf-8cb4cea6f828 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:14.893187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484a8a-ba5f-42b6-80bf-8cb4cea6f828 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:14.893466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484a8a-ba5f-42b6-80bf-8cb4cea6f828 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:14.903323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484a8a-ba5f-42b6-80bf-8cb4cea6f828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-e2484a8a-ba5f-42b6-80bf-8cb4cea6f828 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:14.908103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:14.909320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:14.910253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 559/1101] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:14.915362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a83a89-c15f-4713-9f21-702dc10d0dd7 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:15.012541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a83a89-c15f-4713-9f21-702dc10d0dd7 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:15.046756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfbb69-c365-4317-be4f-af6177881a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:15.047343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfbb69-c365-4317-be4f-af6177881a4e None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:15.047623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfbb69-c365-4317-be4f-af6177881a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:15.047897 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfbb69-c365-4317-be4f-af6177881a4e None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:15.048575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfbb69-c365-4317-be4f-af6177881a4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:15.048899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfbb69-c365-4317-be4f-af6177881a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:15.050270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfbb69-c365-4317-be4f-af6177881a4e None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:15.058048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 543/1102] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:15.063824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484a8a-ba5f-42b6-80bf-8cb4cea6f828 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:15.161609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484a8a-ba5f-42b6-80bf-8cb4cea6f828 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:15.195508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c3689-7a0c-4eea-8bc0-9a9438459c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:15.196129 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c3689-7a0c-4eea-8bc0-9a9438459c48 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:15.196410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c3689-7a0c-4eea-8bc0-9a9438459c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:15.196681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c3689-7a0c-4eea-8bc0-9a9438459c48 None admin] PATH_INFO: `/v3/users/2e87f254111a4e80a66b74591588fd1e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:15.197780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c3689-7a0c-4eea-8bc0-9a9438459c48 None admin] RBAC: Authorizing `identity:get_user(user_id=2e87f254111a4e80a66b74591588fd1e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:15.199236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c3689-7a0c-4eea-8bc0-9a9438459c48 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:15.200797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 560/1103] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:15 2022] GET /identity/v3/users/2e87f254111a4e80a66b74591588fd1e => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:15.207245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfbb69-c365-4317-be4f-af6177881a4e None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:15.255996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:15.304272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfbb69-c365-4317-be4f-af6177881a4e None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:15.338155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1d749-7e4c-4059-93f2-ecbe20ee30cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:15.338766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1d749-7e4c-4059-93f2-ecbe20ee30cc None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:15.339049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1d749-7e4c-4059-93f2-ecbe20ee30cc None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:15.339324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1d749-7e4c-4059-93f2-ecbe20ee30cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:15.403654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1d749-7e4c-4059-93f2-ecbe20ee30cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:15.405081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1d749-7e4c-4059-93f2-ecbe20ee30cc None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:15.454286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:15.506182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 544/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:15.512304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c3689-7a0c-4eea-8bc0-9a9438459c48 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:15.539806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:15.609373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c3689-7a0c-4eea-8bc0-9a9438459c48 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:15.641913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3e719-c3a0-43c7-bb4c-d04509f9c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:15.642574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3e719-c3a0-43c7-bb4c-d04509f9c389 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:15.642856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3e719-c3a0-43c7-bb4c-d04509f9c389 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:15.643130 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3e719-c3a0-43c7-bb4c-d04509f9c389 None admin] PATH_INFO: `/v3/projects/35bdc5293d244656ac8568c90a49f13f` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:15.644219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3e719-c3a0-43c7-bb4c-d04509f9c389 None admin] RBAC: Authorizing `identity:get_project(project_id=35bdc5293d244656ac8568c90a49f13f)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:15.645645 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3e719-c3a0-43c7-bb4c-d04509f9c389 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:15.647256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 561/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:15 2022] GET /identity/v3/projects/35bdc5293d244656ac8568c90a49f13f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:15.653353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1d749-7e4c-4059-93f2-ecbe20ee30cc None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:15.750778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1d749-7e4c-4059-93f2-ecbe20ee30cc None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:15.784430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3afafa-a509-4bee-9a0c-7064871116b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:15.785019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3afafa-a509-4bee-9a0c-7064871116b6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:15.785299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3afafa-a509-4bee-9a0c-7064871116b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:15.785575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3afafa-a509-4bee-9a0c-7064871116b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:15.786389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3afafa-a509-4bee-9a0c-7064871116b6 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=35bdc5293d244656ac8568c90a49f13f, user.id=2e87f254111a4e80a66b74591588fd1e) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:15.786700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3afafa-a509-4bee-9a0c-7064871116b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:15.788121 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3afafa-a509-4bee-9a0c-7064871116b6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:15.793812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 545/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:15 2022] GET /identity/v3/role_assignments?user.id=2e87f254111a4e80a66b74591588fd1e&scope.project.id=35bdc5293d244656ac8568c90a49f13f&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:17.732403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6269a-c97c-486e-997e-455d68f6b37b None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:17.732954 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6269a-c97c-486e-997e-455d68f6b37b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:17.732954 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6269a-c97c-486e-997e-455d68f6b37b None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:17.734324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 562/1107] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:17.739722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fd388-4cec-45cc-806c-d4f236d9b10b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:17.740140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fd388-4cec-45cc-806c-d4f236d9b10b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:17.740278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fd388-4cec-45cc-806c-d4f236d9b10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:17.757752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a25fd388-4cec-45cc-806c-d4f236d9b10b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:17.758965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a25fd388-4cec-45cc-806c-d4f236d9b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:17.768527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:17.824420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 546/1108] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:18.103249 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6269a-c97c-486e-997e-455d68f6b37b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:18.198172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:18.205373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6269a-c97c-486e-997e-455d68f6b37b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:18.239714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa5dca-2149-4c61-98c7-b7bba4b0fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:18.240337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa5dca-2149-4c61-98c7-b7bba4b0fb0c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:18.240620 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa5dca-2149-4c61-98c7-b7bba4b0fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:18.240896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa5dca-2149-4c61-98c7-b7bba4b0fb0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:18.242011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa5dca-2149-4c61-98c7-b7bba4b0fb0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:18.243489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa5dca-2149-4c61-98c7-b7bba4b0fb0c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:18.245040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 563/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:18.250776 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fd388-4cec-45cc-806c-d4f236d9b10b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:18.348114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fd388-4cec-45cc-806c-d4f236d9b10b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:18.382000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da0f90-1e69-4bad-ac5c-b498e8d83e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:18.382558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0f90-1e69-4bad-ac5c-b498e8d83e69 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:18.382841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0f90-1e69-4bad-ac5c-b498e8d83e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:18.383112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0f90-1e69-4bad-ac5c-b498e8d83e69 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:18.383755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da0f90-1e69-4bad-ac5c-b498e8d83e69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:18.385169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da0f90-1e69-4bad-ac5c-b498e8d83e69 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:18.478085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:18.482829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 547/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:28:18 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:20.400477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088539-053d-4e1b-a25d-8948e7633173 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:20.401029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088539-053d-4e1b-a25d-8948e7633173 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:20.401029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088539-053d-4e1b-a25d-8948e7633173 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:20.402398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 564/1111] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:20.407533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c2e44-f42c-40f0-a1fb-04caf3a76a28 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:20.408583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c2e44-f42c-40f0-a1fb-04caf3a76a28 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:20.408777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c2e44-f42c-40f0-a1fb-04caf3a76a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:20.427958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-8a9c2e44-f42c-40f0-a1fb-04caf3a76a28 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:20.429056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8a9c2e44-f42c-40f0-a1fb-04caf3a76a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:20.494126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 548/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:20.764041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a088539-053d-4e1b-a25d-8948e7633173 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:20.863015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a088539-053d-4e1b-a25d-8948e7633173 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:20.894722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed57f83-4be3-4bae-94e6-d2309dc80dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:20.895337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed57f83-4be3-4bae-94e6-d2309dc80dff None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:20.895617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed57f83-4be3-4bae-94e6-d2309dc80dff None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:20.895892 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed57f83-4be3-4bae-94e6-d2309dc80dff None admin] PATH_INFO: `/v3/roles/60c41aabe4694d07bf0b66f5223c3d0d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:20.897258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed57f83-4be3-4bae-94e6-d2309dc80dff None admin] RBAC: Authorizing `identity:get_role(role_id=60c41aabe4694d07bf0b66f5223c3d0d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:20.898654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed57f83-4be3-4bae-94e6-d2309dc80dff None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:20.899940 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 565/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:20 2022] GET /identity/v3/roles/60c41aabe4694d07bf0b66f5223c3d0d => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:20.905706 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c2e44-f42c-40f0-a1fb-04caf3a76a28 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:21.004885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c2e44-f42c-40f0-a1fb-04caf3a76a28 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:21.032015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:21.038125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ec055-e745-41b9-9426-e2b6ea9732a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:21.038810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ec055-e745-41b9-9426-e2b6ea9732a6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:21.039109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ec055-e745-41b9-9426-e2b6ea9732a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:21.039368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ec055-e745-41b9-9426-e2b6ea9732a6 None admin] PATH_INFO: `/v3/users/094dbb1be43d4088a5ff1cae232f20c3` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:21.052614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ec055-e745-41b9-9426-e2b6ea9732a6 None admin] RBAC: Authorizing `identity:get_user(user_id=094dbb1be43d4088a5ff1cae232f20c3)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:21.054051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ec055-e745-41b9-9426-e2b6ea9732a6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:21.055657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 549/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:20 2022] GET /identity/v3/users/094dbb1be43d4088a5ff1cae232f20c3 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:21.061456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed57f83-4be3-4bae-94e6-d2309dc80dff None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:21.091962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:21.159757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed57f83-4be3-4bae-94e6-d2309dc80dff None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:21.195132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1903d-7122-4516-a9d9-d8d7909f8e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:21.195746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1903d-7122-4516-a9d9-d8d7909f8e28 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:21.196028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1903d-7122-4516-a9d9-d8d7909f8e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:21.196306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1903d-7122-4516-a9d9-d8d7909f8e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:21.269897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1903d-7122-4516-a9d9-d8d7909f8e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:21.271412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1903d-7122-4516-a9d9-d8d7909f8e28 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:21.300988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:21.368027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 566/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:21.373994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ec055-e745-41b9-9426-e2b6ea9732a6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:21.470960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ec055-e745-41b9-9426-e2b6ea9732a6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:21.504581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896e962-d957-4c88-8614-7f9ed7022027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:21.505194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e962-d957-4c88-8614-7f9ed7022027 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:21.505475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e962-d957-4c88-8614-7f9ed7022027 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:21.505747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e962-d957-4c88-8614-7f9ed7022027 None admin] PATH_INFO: `/v3/projects/35bdc5293d244656ac8568c90a49f13f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:21.506859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896e962-d957-4c88-8614-7f9ed7022027 None admin] RBAC: Authorizing `identity:get_project(project_id=35bdc5293d244656ac8568c90a49f13f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:21.508283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896e962-d957-4c88-8614-7f9ed7022027 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:21.509883 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 550/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:21 2022] GET /identity/v3/projects/35bdc5293d244656ac8568c90a49f13f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:21.516100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1903d-7122-4516-a9d9-d8d7909f8e28 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:21.613013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1903d-7122-4516-a9d9-d8d7909f8e28 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:21.640730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:21.645701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1105bb-317a-4d1a-8e72-23c9c95c8889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:21.646333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1105bb-317a-4d1a-8e72-23c9c95c8889 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:21.646618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1105bb-317a-4d1a-8e72-23c9c95c8889 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:21.646898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1105bb-317a-4d1a-8e72-23c9c95c8889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:21.647613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1105bb-317a-4d1a-8e72-23c9c95c8889 None admin] RBAC: Adding query filter params (role.id=60c41aabe4694d07bf0b66f5223c3d0d, scope.project.id=35bdc5293d244656ac8568c90a49f13f, user.id=094dbb1be43d4088a5ff1cae232f20c3) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:21.647927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1105bb-317a-4d1a-8e72-23c9c95c8889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:21.649373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1105bb-317a-4d1a-8e72-23c9c95c8889 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:21.654571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 567/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:21 2022] GET /identity/v3/role_assignments?user.id=094dbb1be43d4088a5ff1cae232f20c3&scope.project.id=35bdc5293d244656ac8568c90a49f13f&role.id=60c41aabe4694d07bf0b66f5223c3d0d => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:23.521998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67617d6-eeb2-4932-bd39-c4ca922affd6 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:23.522567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67617d6-eeb2-4932-bd39-c4ca922affd6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:23.522567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67617d6-eeb2-4932-bd39-c4ca922affd6 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:23.523866 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 551/1118] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:23.529075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ab21b-888c-4f7e-a90b-e78be19d3e17 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:23.529497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ab21b-888c-4f7e-a90b-e78be19d3e17 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:23.529629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ab21b-888c-4f7e-a90b-e78be19d3e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:23.547195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-539ab21b-888c-4f7e-a90b-e78be19d3e17 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:23.548920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-539ab21b-888c-4f7e-a90b-e78be19d3e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:23.613438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 568/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:23.884943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67617d6-eeb2-4932-bd39-c4ca922affd6 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:23.941692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:23.984856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67617d6-eeb2-4932-bd39-c4ca922affd6 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:24.018804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53872f-ab51-47c7-882f-e9f25e8abfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:24.019424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53872f-ab51-47c7-882f-e9f25e8abfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:24.019708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53872f-ab51-47c7-882f-e9f25e8abfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:24.019987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53872f-ab51-47c7-882f-e9f25e8abfb6 None admin] PATH_INFO: `/v3/roles/60c41aabe4694d07bf0b66f5223c3d0d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:24.021370 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53872f-ab51-47c7-882f-e9f25e8abfb6 None admin] RBAC: Authorizing `identity:get_role(role_id=60c41aabe4694d07bf0b66f5223c3d0d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:24.022767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53872f-ab51-47c7-882f-e9f25e8abfb6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:24.024172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 552/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:23 2022] GET /identity/v3/roles/60c41aabe4694d07bf0b66f5223c3d0d => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:24.030104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ab21b-888c-4f7e-a90b-e78be19d3e17 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:24.125916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ab21b-888c-4f7e-a90b-e78be19d3e17 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:24.151626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:24.160047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01151-5b6c-4dc0-9e7e-150a5a28dbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:24.164488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01151-5b6c-4dc0-9e7e-150a5a28dbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:24.164488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01151-5b6c-4dc0-9e7e-150a5a28dbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:24.164488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01151-5b6c-4dc0-9e7e-150a5a28dbe9 None admin] PATH_INFO: `/v3/users/094dbb1be43d4088a5ff1cae232f20c3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:24.164488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf01151-5b6c-4dc0-9e7e-150a5a28dbe9 None admin] RBAC: Authorizing `identity:get_user(user_id=094dbb1be43d4088a5ff1cae232f20c3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:24.164488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf01151-5b6c-4dc0-9e7e-150a5a28dbe9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:24.165297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 569/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:24 2022] GET /identity/v3/users/094dbb1be43d4088a5ff1cae232f20c3 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:24.171317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53872f-ab51-47c7-882f-e9f25e8abfb6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:24.270521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53872f-ab51-47c7-882f-e9f25e8abfb6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:24.293070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:24.304169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62528d-76bd-4ba8-aac2-543b6e157845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:24.304791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62528d-76bd-4ba8-aac2-543b6e157845 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:24.305070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62528d-76bd-4ba8-aac2-543b6e157845 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:24.305343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62528d-76bd-4ba8-aac2-543b6e157845 None admin] PATH_INFO: `/v3/projects/35bdc5293d244656ac8568c90a49f13f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:24.306467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62528d-76bd-4ba8-aac2-543b6e157845 None admin] RBAC: Authorizing `identity:get_project(project_id=35bdc5293d244656ac8568c90a49f13f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:24.308004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62528d-76bd-4ba8-aac2-543b6e157845 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:24.309594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 553/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:24 2022] GET /identity/v3/projects/35bdc5293d244656ac8568c90a49f13f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:24.316336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01151-5b6c-4dc0-9e7e-150a5a28dbe9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:24.414727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01151-5b6c-4dc0-9e7e-150a5a28dbe9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:24.448619 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4ab8-1d9d-45c4-b977-a88013652993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:24.449262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4ab8-1d9d-45c4-b977-a88013652993 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:24.449541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4ab8-1d9d-45c4-b977-a88013652993 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:24.449817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4ab8-1d9d-45c4-b977-a88013652993 None admin] PATH_INFO: `/v3/projects/35bdc5293d244656ac8568c90a49f13f/users/094dbb1be43d4088a5ff1cae232f20c3/roles/60c41aabe4694d07bf0b66f5223c3d0d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:24.451926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea4ab8-1d9d-45c4-b977-a88013652993 None admin] RBAC: Authorizing `identity:create_grant(project_id=35bdc5293d244656ac8568c90a49f13f, user_id=094dbb1be43d4088a5ff1cae232f20c3, role_id=60c41aabe4694d07bf0b66f5223c3d0d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:24.453357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea4ab8-1d9d-45c4-b977-a88013652993 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:24.549263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 570/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:28:24 2022] PUT /identity/v3/projects/35bdc5293d244656ac8568c90a49f13f/users/094dbb1be43d4088a5ff1cae232f20c3/roles/60c41aabe4694d07bf0b66f5223c3d0d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:28:26.411919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b19f0-69ea-4067-a4a5-f3d2f1e33178 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:26.412445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b19f0-69ea-4067-a4a5-f3d2f1e33178 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:26.412445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b19f0-69ea-4067-a4a5-f3d2f1e33178 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:26.413802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 554/1124] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:26.418927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ccee7-93a4-4b83-9a75-34056ad4ab12 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:26.419352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ccee7-93a4-4b83-9a75-34056ad4ab12 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:26.419465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ccee7-93a4-4b83-9a75-34056ad4ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:26.437602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7e9ccee7-93a4-4b83-9a75-34056ad4ab12 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:26.439247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7e9ccee7-93a4-4b83-9a75-34056ad4ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:26.487535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:26.504651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 571/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:26.769677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b19f0-69ea-4067-a4a5-f3d2f1e33178 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:26.869312 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b19f0-69ea-4067-a4a5-f3d2f1e33178 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:26.902808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949464-1fb8-40a3-8941-578087a0cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:26.903417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949464-1fb8-40a3-8941-578087a0cc90 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:26.903696 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949464-1fb8-40a3-8941-578087a0cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:26.903967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949464-1fb8-40a3-8941-578087a0cc90 None admin] PATH_INFO: `/v3/roles/60c41aabe4694d07bf0b66f5223c3d0d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:26.905327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949464-1fb8-40a3-8941-578087a0cc90 None admin] RBAC: Authorizing `identity:get_role(role_id=60c41aabe4694d07bf0b66f5223c3d0d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:26.906701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949464-1fb8-40a3-8941-578087a0cc90 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:26.908815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 555/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:26 2022] GET /identity/v3/roles/60c41aabe4694d07bf0b66f5223c3d0d => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:26.914565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ccee7-93a4-4b83-9a75-34056ad4ab12 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:27.011166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ccee7-93a4-4b83-9a75-34056ad4ab12 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:27.043770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67982ff-924a-4782-a5ef-bb530f6a5648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:27.044339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67982ff-924a-4782-a5ef-bb530f6a5648 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:27.044622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67982ff-924a-4782-a5ef-bb530f6a5648 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:27.044901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67982ff-924a-4782-a5ef-bb530f6a5648 None admin] PATH_INFO: `/v3/users/094dbb1be43d4088a5ff1cae232f20c3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:27.046011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67982ff-924a-4782-a5ef-bb530f6a5648 None admin] RBAC: Authorizing `identity:get_user(user_id=094dbb1be43d4088a5ff1cae232f20c3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:27.047491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67982ff-924a-4782-a5ef-bb530f6a5648 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:27.049854 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 572/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:26 2022] GET /identity/v3/users/094dbb1be43d4088a5ff1cae232f20c3 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:27.055610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949464-1fb8-40a3-8941-578087a0cc90 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:27.118358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:27.158107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949464-1fb8-40a3-8941-578087a0cc90 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:27.192189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6d02-bc25-40c8-9018-bda4e2b268f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:27.192798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6d02-bc25-40c8-9018-bda4e2b268f0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:27.193079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6d02-bc25-40c8-9018-bda4e2b268f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:27.193351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6d02-bc25-40c8-9018-bda4e2b268f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:27.258530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe6d02-bc25-40c8-9018-bda4e2b268f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:27.259988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe6d02-bc25-40c8-9018-bda4e2b268f0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:27.315846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:27.355911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 556/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:27.362045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67982ff-924a-4782-a5ef-bb530f6a5648 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:27.416696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:27.462622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67982ff-924a-4782-a5ef-bb530f6a5648 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:27.495692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613934e-62b3-4cdd-861c-05a88b98e967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:27.496321 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613934e-62b3-4cdd-861c-05a88b98e967 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:27.496607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613934e-62b3-4cdd-861c-05a88b98e967 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:27.496883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613934e-62b3-4cdd-861c-05a88b98e967 None admin] PATH_INFO: `/v3/projects/35bdc5293d244656ac8568c90a49f13f` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:27.497991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613934e-62b3-4cdd-861c-05a88b98e967 None admin] RBAC: Authorizing `identity:get_project(project_id=35bdc5293d244656ac8568c90a49f13f)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:27.499466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613934e-62b3-4cdd-861c-05a88b98e967 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:27.501107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 573/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:27 2022] GET /identity/v3/projects/35bdc5293d244656ac8568c90a49f13f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:27.507886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6d02-bc25-40c8-9018-bda4e2b268f0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:27.605511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6d02-bc25-40c8-9018-bda4e2b268f0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:27.638681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7e94e-8c5a-4654-bb8f-193af597bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:27.639272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e94e-8c5a-4654-bb8f-193af597bb96 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:27.639550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e94e-8c5a-4654-bb8f-193af597bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:27.639820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e94e-8c5a-4654-bb8f-193af597bb96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:27.640559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7e94e-8c5a-4654-bb8f-193af597bb96 None admin] RBAC: Adding query filter params (role.id=60c41aabe4694d07bf0b66f5223c3d0d, scope.project.id=35bdc5293d244656ac8568c90a49f13f, user.id=094dbb1be43d4088a5ff1cae232f20c3) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:27.640869 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7e94e-8c5a-4654-bb8f-193af597bb96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:27.642309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7e94e-8c5a-4654-bb8f-193af597bb96 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:27.647861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 557/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:27 2022] GET /identity/v3/role_assignments?user.id=094dbb1be43d4088a5ff1cae232f20c3&scope.project.id=35bdc5293d244656ac8568c90a49f13f&role.id=60c41aabe4694d07bf0b66f5223c3d0d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:29.586217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be79bd-30c0-434e-99bd-fd25a00d2de7 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:29.586856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be79bd-30c0-434e-99bd-fd25a00d2de7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:29.586856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be79bd-30c0-434e-99bd-fd25a00d2de7 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:29.588100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 574/1131] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:29.593232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1db4f-e2d7-492d-b3a0-048703d04bbc None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:29.593653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1db4f-e2d7-492d-b3a0-048703d04bbc None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:29.593775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1db4f-e2d7-492d-b3a0-048703d04bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:29.612010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-dbb1db4f-e2d7-492d-b3a0-048703d04bbc None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:29.613169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-dbb1db4f-e2d7-492d-b3a0-048703d04bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:29.630670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:29.678018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 558/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:29.949794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be79bd-30c0-434e-99bd-fd25a00d2de7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:30.053905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be79bd-30c0-434e-99bd-fd25a00d2de7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:30.074026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:30.088010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd11908-d47a-4d01-827c-0dc080366dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:30.088637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd11908-d47a-4d01-827c-0dc080366dac None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:30.088919 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd11908-d47a-4d01-827c-0dc080366dac None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:30.089194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd11908-d47a-4d01-827c-0dc080366dac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:30.090323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd11908-d47a-4d01-827c-0dc080366dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:30.091759 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd11908-d47a-4d01-827c-0dc080366dac None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:30.093372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 575/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:30.099663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1db4f-e2d7-492d-b3a0-048703d04bbc None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:30.195682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1db4f-e2d7-492d-b3a0-048703d04bbc None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:30.228919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251085af-1631-41b8-8df0-211deb42dec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:30.229454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251085af-1631-41b8-8df0-211deb42dec9 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:30.229733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251085af-1631-41b8-8df0-211deb42dec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:30.230004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251085af-1631-41b8-8df0-211deb42dec9 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:30.230667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251085af-1631-41b8-8df0-211deb42dec9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:30.232080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251085af-1631-41b8-8df0-211deb42dec9 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:30.326873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 559/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:28:30 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:32.254949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8519e-941c-4c1c-a375-313ce8298ed6 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:32.255481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8519e-941c-4c1c-a375-313ce8298ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:32.255481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8519e-941c-4c1c-a375-313ce8298ed6 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:32.256835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 576/1135] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:32.262099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077cd62-6369-411e-bb7f-d27837678cc0 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:32.262511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077cd62-6369-411e-bb7f-d27837678cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:32.262708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077cd62-6369-411e-bb7f-d27837678cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:32.275976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:32.281190 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-8077cd62-6369-411e-bb7f-d27837678cc0 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:32.282937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8077cd62-6369-411e-bb7f-d27837678cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:32.347802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 560/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:32.618564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8519e-941c-4c1c-a375-313ce8298ed6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:32.718624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8519e-941c-4c1c-a375-313ce8298ed6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:32.751608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaf2c2-5a9e-4952-b3ff-1006d37a35e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:32.752224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaf2c2-5a9e-4952-b3ff-1006d37a35e2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:32.752505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaf2c2-5a9e-4952-b3ff-1006d37a35e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:32.752780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaf2c2-5a9e-4952-b3ff-1006d37a35e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:32.753881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaf2c2-5a9e-4952-b3ff-1006d37a35e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:32.755356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaf2c2-5a9e-4952-b3ff-1006d37a35e2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:32.756909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 577/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:32.762644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077cd62-6369-411e-bb7f-d27837678cc0 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:32.859569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077cd62-6369-411e-bb7f-d27837678cc0 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:32.892478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97a76e-d324-4da9-ac00-5d80ff5a3f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:32.893005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97a76e-d324-4da9-ac00-5d80ff5a3f2f None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:32.893285 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97a76e-d324-4da9-ac00-5d80ff5a3f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:32.893554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97a76e-d324-4da9-ac00-5d80ff5a3f2f None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:32.894179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97a76e-d324-4da9-ac00-5d80ff5a3f2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:32.895614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97a76e-d324-4da9-ac00-5d80ff5a3f2f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:32.904055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:32.995896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 561/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:28:32 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:34.907000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d49d4b-fca5-4d40-8cbd-869ffb37b122 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:34.907643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d49d4b-fca5-4d40-8cbd-869ffb37b122 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:34.907643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d49d4b-fca5-4d40-8cbd-869ffb37b122 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:34.908921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 578/1139] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:34.914266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f46fc-da55-4f05-bdb0-2d72ced15b02 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:34.914664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f46fc-da55-4f05-bdb0-2d72ced15b02 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:34.914823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f46fc-da55-4f05-bdb0-2d72ced15b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:34.932885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-254f46fc-da55-4f05-bdb0-2d72ced15b02 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:34.934058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-254f46fc-da55-4f05-bdb0-2d72ced15b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:34.998892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 562/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:35.267226 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d49d4b-fca5-4d40-8cbd-869ffb37b122 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:35.324553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:35.367772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d49d4b-fca5-4d40-8cbd-869ffb37b122 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:35.401307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8c4c6-1132-4da9-bae6-0ce5cd6f228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:35.401928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c4c6-1132-4da9-bae6-0ce5cd6f228b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:35.402231 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c4c6-1132-4da9-bae6-0ce5cd6f228b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:35.402514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c4c6-1132-4da9-bae6-0ce5cd6f228b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:35.412400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8c4c6-1132-4da9-bae6-0ce5cd6f228b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3da8c4c6-1132-4da9-bae6-0ce5cd6f228b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:35.417068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:35.418345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:35.419472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 579/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:35.424383 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f46fc-da55-4f05-bdb0-2d72ced15b02 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:35.519721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f46fc-da55-4f05-bdb0-2d72ced15b02 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:35.541690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:35.553298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce187401-e031-493c-97b0-2924132cebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:35.553897 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce187401-e031-493c-97b0-2924132cebf2 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:35.554174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce187401-e031-493c-97b0-2924132cebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:35.554474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce187401-e031-493c-97b0-2924132cebf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:35.555129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce187401-e031-493c-97b0-2924132cebf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:35.555432 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce187401-e031-493c-97b0-2924132cebf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:35.556788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce187401-e031-493c-97b0-2924132cebf2 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:35.565568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 563/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:35.571237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8c4c6-1132-4da9-bae6-0ce5cd6f228b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:35.672378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8c4c6-1132-4da9-bae6-0ce5cd6f228b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:35.691120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:35.708020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1b90-2ab2-40ba-90cd-cb1f68ac4106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:35.708643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1b90-2ab2-40ba-90cd-cb1f68ac4106 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:35.708923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1b90-2ab2-40ba-90cd-cb1f68ac4106 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:35.709192 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1b90-2ab2-40ba-90cd-cb1f68ac4106 None admin] PATH_INFO: `/v3/users/5cb140f04fe74906892415f1377c533d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:35.721796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a1b90-2ab2-40ba-90cd-cb1f68ac4106 None admin] RBAC: Authorizing `identity:get_user(user_id=5cb140f04fe74906892415f1377c533d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:35.723264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a1b90-2ab2-40ba-90cd-cb1f68ac4106 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:35.725249 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 580/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:35 2022] GET /identity/v3/users/5cb140f04fe74906892415f1377c533d => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:35.730851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce187401-e031-493c-97b0-2924132cebf2 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:35.828175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce187401-e031-493c-97b0-2924132cebf2 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:35.860982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003a642-aff9-4165-a2d1-67d12bfd3fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:35.861737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003a642-aff9-4165-a2d1-67d12bfd3fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:35.862019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003a642-aff9-4165-a2d1-67d12bfd3fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:35.862320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003a642-aff9-4165-a2d1-67d12bfd3fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:35.912766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:35.928556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003a642-aff9-4165-a2d1-67d12bfd3fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:35.930000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003a642-aff9-4165-a2d1-67d12bfd3fa4 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:36.033423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 564/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:36.039276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1b90-2ab2-40ba-90cd-cb1f68ac4106 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:36.136213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1b90-2ab2-40ba-90cd-cb1f68ac4106 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:36.168457 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97181c5-60f0-478e-9e65-73d3d57a7583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:36.169069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97181c5-60f0-478e-9e65-73d3d57a7583 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:36.169356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97181c5-60f0-478e-9e65-73d3d57a7583 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:36.169633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97181c5-60f0-478e-9e65-73d3d57a7583 None admin] PATH_INFO: `/v3/projects/b16b6b81dea9486087cc6a9f1f7b8eed` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:36.170779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97181c5-60f0-478e-9e65-73d3d57a7583 None admin] RBAC: Authorizing `identity:get_project(project_id=b16b6b81dea9486087cc6a9f1f7b8eed)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:36.172216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97181c5-60f0-478e-9e65-73d3d57a7583 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:36.177776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 581/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:36 2022] GET /identity/v3/projects/b16b6b81dea9486087cc6a9f1f7b8eed => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:36.180842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003a642-aff9-4165-a2d1-67d12bfd3fa4 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:36.262519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:36.278136 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003a642-aff9-4165-a2d1-67d12bfd3fa4 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:36.311687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa44cb-e27c-4515-b0ca-7e0857298798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:36.312280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa44cb-e27c-4515-b0ca-7e0857298798 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:36.312561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa44cb-e27c-4515-b0ca-7e0857298798 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:36.312826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa44cb-e27c-4515-b0ca-7e0857298798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:36.313577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa44cb-e27c-4515-b0ca-7e0857298798 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=b16b6b81dea9486087cc6a9f1f7b8eed, user.id=5cb140f04fe74906892415f1377c533d) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:36.314056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa44cb-e27c-4515-b0ca-7e0857298798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:36.315767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa44cb-e27c-4515-b0ca-7e0857298798 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:36.321012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 565/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:36 2022] GET /identity/v3/role_assignments?user.id=5cb140f04fe74906892415f1377c533d&scope.project.id=b16b6b81dea9486087cc6a9f1f7b8eed&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:38.185677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb64ea0-11f0-4c2b-bd31-9c1d041f0cd6 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.186080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb64ea0-11f0-4c2b-bd31-9c1d041f0cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.186271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb64ea0-11f0-4c2b-bd31-9c1d041f0cd6 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.187625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 582/1147] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:38.193761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aea75-45d4-4894-9064-aeafc780ce6b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.194171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aea75-45d4-4894-9064-aeafc780ce6b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.194323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aea75-45d4-4894-9064-aeafc780ce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.212635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-290aea75-45d4-4894-9064-aeafc780ce6b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:38.213802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-290aea75-45d4-4894-9064-aeafc780ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:38.278749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 566/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:38.549243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb64ea0-11f0-4c2b-bd31-9c1d041f0cd6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:38.592518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:38.647436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb64ea0-11f0-4c2b-bd31-9c1d041f0cd6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:38.679910 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19016e-5cf3-43fc-997e-01c08f524e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:38.680523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19016e-5cf3-43fc-997e-01c08f524e5f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.680820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19016e-5cf3-43fc-997e-01c08f524e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.681076 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19016e-5cf3-43fc-997e-01c08f524e5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.691251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19016e-5cf3-43fc-997e-01c08f524e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-4c19016e-5cf3-43fc-997e-01c08f524e5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:38.695861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:38.697012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:38.698358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 583/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:38.702926 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290aea75-45d4-4894-9064-aeafc780ce6b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:38.779057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:38.800293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290aea75-45d4-4894-9064-aeafc780ce6b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:38.833437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0f311-f60e-4547-b93e-b1f39068a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:38.834027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0f311-f60e-4547-b93e-b1f39068a87d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.834332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0f311-f60e-4547-b93e-b1f39068a87d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.834604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0f311-f60e-4547-b93e-b1f39068a87d None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.835253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0f311-f60e-4547-b93e-b1f39068a87d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:38.835553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0f311-f60e-4547-b93e-b1f39068a87d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:38.836904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0f311-f60e-4547-b93e-b1f39068a87d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:38.845172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 567/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:38.851310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19016e-5cf3-43fc-997e-01c08f524e5f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:38.949804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19016e-5cf3-43fc-997e-01c08f524e5f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:38.951340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:38.982570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbcda7-00cc-4b7d-b8ec-f38aa57e2d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:38.983189 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbcda7-00cc-4b7d-b8ec-f38aa57e2d2f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.983470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbcda7-00cc-4b7d-b8ec-f38aa57e2d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.983745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbcda7-00cc-4b7d-b8ec-f38aa57e2d2f None admin] PATH_INFO: `/v3/users/5cb140f04fe74906892415f1377c533d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.984844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbcda7-00cc-4b7d-b8ec-f38aa57e2d2f None admin] RBAC: Authorizing `identity:get_user(user_id=5cb140f04fe74906892415f1377c533d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:38.986593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbcda7-00cc-4b7d-b8ec-f38aa57e2d2f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:38.988547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 584/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:38 2022] GET /identity/v3/users/5cb140f04fe74906892415f1377c533d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:38.993901 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0f311-f60e-4547-b93e-b1f39068a87d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:39.091817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0f311-f60e-4547-b93e-b1f39068a87d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:39.123624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bfe99-0aed-47b3-9a68-34370b507bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:39.124239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bfe99-0aed-47b3-9a68-34370b507bdd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:39.124520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bfe99-0aed-47b3-9a68-34370b507bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:39.124794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bfe99-0aed-47b3-9a68-34370b507bdd None admin] PATH_INFO: `/v3/projects/b16b6b81dea9486087cc6a9f1f7b8eed` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:39.126426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bfe99-0aed-47b3-9a68-34370b507bdd None admin] RBAC: Authorizing `identity:get_project(project_id=b16b6b81dea9486087cc6a9f1f7b8eed)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:39.127882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bfe99-0aed-47b3-9a68-34370b507bdd None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:39.129462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 568/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:38 2022] GET /identity/v3/projects/b16b6b81dea9486087cc6a9f1f7b8eed => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:39.135182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbcda7-00cc-4b7d-b8ec-f38aa57e2d2f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:39.232010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbcda7-00cc-4b7d-b8ec-f38aa57e2d2f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:39.266985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3c72e-7814-4e98-a7f4-f0c5dc0d21bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:39.267632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c72e-7814-4e98-a7f4-f0c5dc0d21bb None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:39.267915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c72e-7814-4e98-a7f4-f0c5dc0d21bb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:39.268188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c72e-7814-4e98-a7f4-f0c5dc0d21bb None admin] PATH_INFO: `/v3/projects/b16b6b81dea9486087cc6a9f1f7b8eed/users/5cb140f04fe74906892415f1377c533d/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:39.270064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3c72e-7814-4e98-a7f4-f0c5dc0d21bb None admin] RBAC: Authorizing `identity:create_grant(project_id=b16b6b81dea9486087cc6a9f1f7b8eed, user_id=5cb140f04fe74906892415f1377c533d, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:39.271536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3c72e-7814-4e98-a7f4-f0c5dc0d21bb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:39.350247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 585/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:28:39 2022] PUT /identity/v3/projects/b16b6b81dea9486087cc6a9f1f7b8eed/users/5cb140f04fe74906892415f1377c533d/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:28:41.218073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c29b8-5d95-4651-946b-dbb7344ca524 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:41.218605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c29b8-5d95-4651-946b-dbb7344ca524 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:41.218718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c29b8-5d95-4651-946b-dbb7344ca524 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:41.220663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 569/1154] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:41.225985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6763-8b46-4675-ad31-221e7f1f0971 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:41.226420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6763-8b46-4675-ad31-221e7f1f0971 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:41.226577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6763-8b46-4675-ad31-221e7f1f0971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:41.244976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fd0c6763-8b46-4675-ad31-221e7f1f0971 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:41.246232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fd0c6763-8b46-4675-ad31-221e7f1f0971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:41.270351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:41.312769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 586/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:41.584518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c29b8-5d95-4651-946b-dbb7344ca524 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:41.596508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:41.683865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c29b8-5d95-4651-946b-dbb7344ca524 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:41.716395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eb0e1-7d63-4b0e-9bd8-96f1fe1814ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:41.717013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eb0e1-7d63-4b0e-9bd8-96f1fe1814ab None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:41.717299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eb0e1-7d63-4b0e-9bd8-96f1fe1814ab None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:41.717572 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eb0e1-7d63-4b0e-9bd8-96f1fe1814ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:41.728502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075eb0e1-7d63-4b0e-9bd8-96f1fe1814ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-075eb0e1-7d63-4b0e-9bd8-96f1fe1814ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:41.733118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:41.734233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:41.735597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 570/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:41.740573 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6763-8b46-4675-ad31-221e7f1f0971 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:41.835188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6763-8b46-4675-ad31-221e7f1f0971 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:41.867856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e413f8-cf4a-45d8-853a-b7c85ab53909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:41.868448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e413f8-cf4a-45d8-853a-b7c85ab53909 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:41.868727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e413f8-cf4a-45d8-853a-b7c85ab53909 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:41.868997 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e413f8-cf4a-45d8-853a-b7c85ab53909 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:41.869651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e413f8-cf4a-45d8-853a-b7c85ab53909 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:41.869954 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e413f8-cf4a-45d8-853a-b7c85ab53909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:41.871347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e413f8-cf4a-45d8-853a-b7c85ab53909 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:41.879666 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 587/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:41.885287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eb0e1-7d63-4b0e-9bd8-96f1fe1814ab None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:41.951226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:41.983296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eb0e1-7d63-4b0e-9bd8-96f1fe1814ab None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:42.016013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55ae8-1f05-4239-a774-c5cf5a360c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:42.016758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55ae8-1f05-4239-a774-c5cf5a360c91 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:42.016938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55ae8-1f05-4239-a774-c5cf5a360c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:42.017210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55ae8-1f05-4239-a774-c5cf5a360c91 None admin] PATH_INFO: `/v3/users/5cb140f04fe74906892415f1377c533d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:42.018340 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a55ae8-1f05-4239-a774-c5cf5a360c91 None admin] RBAC: Authorizing `identity:get_user(user_id=5cb140f04fe74906892415f1377c533d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:42.019759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a55ae8-1f05-4239-a774-c5cf5a360c91 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:42.021302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 571/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:41 2022] GET /identity/v3/users/5cb140f04fe74906892415f1377c533d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:42.027100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e413f8-cf4a-45d8-853a-b7c85ab53909 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:42.053097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:42.127634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e413f8-cf4a-45d8-853a-b7c85ab53909 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:42.161769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338f80a-20d1-4b9a-911f-8a3c2fbd028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:42.162394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f80a-20d1-4b9a-911f-8a3c2fbd028f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:42.162676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f80a-20d1-4b9a-911f-8a3c2fbd028f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:42.162949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f80a-20d1-4b9a-911f-8a3c2fbd028f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:42.230460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338f80a-20d1-4b9a-911f-8a3c2fbd028f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:42.231922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338f80a-20d1-4b9a-911f-8a3c2fbd028f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:42.255510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:42.330130 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 588/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:42.336037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55ae8-1f05-4239-a774-c5cf5a360c91 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:42.433925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55ae8-1f05-4239-a774-c5cf5a360c91 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:42.466945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0f591-9458-4488-87a1-0dbb22a6950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:42.467571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0f591-9458-4488-87a1-0dbb22a6950a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:42.467849 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0f591-9458-4488-87a1-0dbb22a6950a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:42.468147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0f591-9458-4488-87a1-0dbb22a6950a None admin] PATH_INFO: `/v3/projects/b16b6b81dea9486087cc6a9f1f7b8eed` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:42.469227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0f591-9458-4488-87a1-0dbb22a6950a None admin] RBAC: Authorizing `identity:get_project(project_id=b16b6b81dea9486087cc6a9f1f7b8eed)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:42.470682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0f591-9458-4488-87a1-0dbb22a6950a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:42.472282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 572/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:42 2022] GET /identity/v3/projects/b16b6b81dea9486087cc6a9f1f7b8eed => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:42.478526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338f80a-20d1-4b9a-911f-8a3c2fbd028f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:42.575755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338f80a-20d1-4b9a-911f-8a3c2fbd028f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:42.598316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:42.609255 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9958b75-ae8d-4904-85d7-52a86f3d7c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:42.609860 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958b75-ae8d-4904-85d7-52a86f3d7c09 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:42.611096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958b75-ae8d-4904-85d7-52a86f3d7c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:42.617880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958b75-ae8d-4904-85d7-52a86f3d7c09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:42.617880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9958b75-ae8d-4904-85d7-52a86f3d7c09 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=b16b6b81dea9486087cc6a9f1f7b8eed, user.id=5cb140f04fe74906892415f1377c533d) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:42.617880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9958b75-ae8d-4904-85d7-52a86f3d7c09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:42.617880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9958b75-ae8d-4904-85d7-52a86f3d7c09 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:42.619071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 589/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:42 2022] GET /identity/v3/role_assignments?user.id=5cb140f04fe74906892415f1377c533d&scope.project.id=b16b6b81dea9486087cc6a9f1f7b8eed&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:44.513386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335e8a9-d77e-437b-90ef-205a69fbc6ef None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:44.513904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335e8a9-d77e-437b-90ef-205a69fbc6ef None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:44.513904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335e8a9-d77e-437b-90ef-205a69fbc6ef None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:44.515219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 573/1162] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:44.520629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12769c5d-3918-46e4-96ca-3150b08e4a94 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:44.521027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12769c5d-3918-46e4-96ca-3150b08e4a94 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:44.521191 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12769c5d-3918-46e4-96ca-3150b08e4a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:44.538930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-12769c5d-3918-46e4-96ca-3150b08e4a94 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:44.540130 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-12769c5d-3918-46e4-96ca-3150b08e4a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:44.605752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 590/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:44.874983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335e8a9-d77e-437b-90ef-205a69fbc6ef None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:44.879413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:44.974950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335e8a9-d77e-437b-90ef-205a69fbc6ef None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:45.007299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46249c5-c145-41ad-a4ec-1b170e724d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:45.007898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46249c5-c145-41ad-a4ec-1b170e724d77 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:45.008176 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46249c5-c145-41ad-a4ec-1b170e724d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:45.008446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46249c5-c145-41ad-a4ec-1b170e724d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:45.075413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46249c5-c145-41ad-a4ec-1b170e724d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:45.076861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46249c5-c145-41ad-a4ec-1b170e724d77 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:45.080167 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:45.173636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 574/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:45.179307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12769c5d-3918-46e4-96ca-3150b08e4a94 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:45.274899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12769c5d-3918-46e4-96ca-3150b08e4a94 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:45.290951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:45.310085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2ab89-d118-485d-a2f9-aabf4afbfe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:45.310751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2ab89-d118-485d-a2f9-aabf4afbfe3f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:45.311036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2ab89-d118-485d-a2f9-aabf4afbfe3f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:45.311313 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2ab89-d118-485d-a2f9-aabf4afbfe3f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:45.319222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2ab89-d118-485d-a2f9-aabf4afbfe3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:45.320825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2ab89-d118-485d-a2f9-aabf4afbfe3f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b0c2ab89-d118-485d-a2f9-aabf4afbfe3f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:45.332371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:45.333595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:28:45.334513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 591/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 22 12:28:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:45.339559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46249c5-c145-41ad-a4ec-1b170e724d77 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:45.437059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46249c5-c145-41ad-a4ec-1b170e724d77 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:45.439659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:45.472051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025ace5-6173-4866-a152-092bd89adf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:45.472649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025ace5-6173-4866-a152-092bd89adf8a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:45.472922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025ace5-6173-4866-a152-092bd89adf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:45.473188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025ace5-6173-4866-a152-092bd89adf8a None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:45.473826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025ace5-6173-4866-a152-092bd89adf8a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:45.474126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025ace5-6173-4866-a152-092bd89adf8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:45.475505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025ace5-6173-4866-a152-092bd89adf8a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:45.482569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 575/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 22 12:28:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:47.382558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015ddd-daf4-43cd-8a0a-5d2dc7c3e6b2 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:47.383136 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015ddd-daf4-43cd-8a0a-5d2dc7c3e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:47.383136 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015ddd-daf4-43cd-8a0a-5d2dc7c3e6b2 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:47.384447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 592/1167] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:47.389683 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362a10-c901-418b-8efd-5164cb51262f None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:47.390104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362a10-c901-418b-8efd-5164cb51262f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:47.390299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362a10-c901-418b-8efd-5164cb51262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:47.408533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-15362a10-c901-418b-8efd-5164cb51262f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:47.409706 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-15362a10-c901-418b-8efd-5164cb51262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:47.474574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 576/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:47.745199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d015ddd-daf4-43cd-8a0a-5d2dc7c3e6b2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:47.848290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d015ddd-daf4-43cd-8a0a-5d2dc7c3e6b2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:47.880942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14c40b-3289-41d4-a4a9-3796e276505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:47.881544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c40b-3289-41d4-a4a9-3796e276505e None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:47.881831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c40b-3289-41d4-a4a9-3796e276505e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:47.882112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c40b-3289-41d4-a4a9-3796e276505e None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:47.882816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14c40b-3289-41d4-a4a9-3796e276505e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:47.884198 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14c40b-3289-41d4-a4a9-3796e276505e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:47.957318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 593/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Aug 22 12:28:47 2022] POST /identity/v3/domains => generated 267 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:49.874592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cdf35-b785-4211-bac2-581b302ab7ce None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:49.875149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cdf35-b785-4211-bac2-581b302ab7ce None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:49.875149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cdf35-b785-4211-bac2-581b302ab7ce None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:49.876508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 577/1170] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:49.882272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748681a-7d5c-4340-adcf-b73fb935d9bf None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:49.882642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748681a-7d5c-4340-adcf-b73fb935d9bf None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:49.882834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748681a-7d5c-4340-adcf-b73fb935d9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:49.900670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6748681a-7d5c-4340-adcf-b73fb935d9bf None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:49.901902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6748681a-7d5c-4340-adcf-b73fb935d9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:49.930137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:49.967668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 594/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:50.245907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cdf35-b785-4211-bac2-581b302ab7ce None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:50.340484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:50.345474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cdf35-b785-4211-bac2-581b302ab7ce None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:50.378335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57399f0-b595-46d3-882e-3e4417da4855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:50.378949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57399f0-b595-46d3-882e-3e4417da4855 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:50.379227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57399f0-b595-46d3-882e-3e4417da4855 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:50.379497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57399f0-b595-46d3-882e-3e4417da4855 None admin] PATH_INFO: `/v3/domains/ee168afd5c62477cbd2194d8b63deaa6` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:50.389493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57399f0-b595-46d3-882e-3e4417da4855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ee168afd5c62477cbd2194d8b63deaa6)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:50.390963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57399f0-b595-46d3-882e-3e4417da4855 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:50.392501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 578/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Aug 22 12:28:50 2022] GET /identity/v3/domains/ee168afd5c62477cbd2194d8b63deaa6 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:50.398347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748681a-7d5c-4340-adcf-b73fb935d9bf None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:50.497978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748681a-7d5c-4340-adcf-b73fb935d9bf None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:50.531304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a56ad-e7c8-43ea-be2c-fc82799934f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:50.532727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a56ad-e7c8-43ea-be2c-fc82799934f4 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:50.533003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a56ad-e7c8-43ea-be2c-fc82799934f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:50.533273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a56ad-e7c8-43ea-be2c-fc82799934f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:50.533916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a56ad-e7c8-43ea-be2c-fc82799934f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:50.535382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a56ad-e7c8-43ea-be2c-fc82799934f4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:50.682174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 595/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:28:50 2022] POST /identity/v3/projects => generated 361 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:28:52.598730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a18f-0169-457a-a4bf-4ff86223dbc2 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:52.599275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a18f-0169-457a-a4bf-4ff86223dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:52.599275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a18f-0169-457a-a4bf-4ff86223dbc2 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:52.600629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 579/1174] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:52.605790 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e9d4a-6d78-4db7-923e-a46d8ad48e4a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:52.606177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e9d4a-6d78-4db7-923e-a46d8ad48e4a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:52.606393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e9d4a-6d78-4db7-923e-a46d8ad48e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:52.624674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-387e9d4a-6d78-4db7-923e-a46d8ad48e4a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:52.625950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-387e9d4a-6d78-4db7-923e-a46d8ad48e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:52.638685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:52.695663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 596/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:52.967192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a18f-0169-457a-a4bf-4ff86223dbc2 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:53.087571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a18f-0169-457a-a4bf-4ff86223dbc2 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:53.131215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904ab01-0446-4909-9476-f1099ad41a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:53.131841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904ab01-0446-4909-9476-f1099ad41a32 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:53.132148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904ab01-0446-4909-9476-f1099ad41a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:53.132422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904ab01-0446-4909-9476-f1099ad41a32 None admin] PATH_INFO: `/v3/domains/ee168afd5c62477cbd2194d8b63deaa6` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:53.133557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904ab01-0446-4909-9476-f1099ad41a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ee168afd5c62477cbd2194d8b63deaa6)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:53.135005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904ab01-0446-4909-9476-f1099ad41a32 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:53.136591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 580/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Aug 22 12:28:52 2022] GET /identity/v3/domains/ee168afd5c62477cbd2194d8b63deaa6 => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:53.143248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e9d4a-6d78-4db7-923e-a46d8ad48e4a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:53.255299 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e9d4a-6d78-4db7-923e-a46d8ad48e4a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:53.291536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbfa40-c896-4567-9c2c-22e6a37c0577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:53.293233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbfa40-c896-4567-9c2c-22e6a37c0577 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:53.293519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbfa40-c896-4567-9c2c-22e6a37c0577 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:53.293797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbfa40-c896-4567-9c2c-22e6a37c0577 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:53.299214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbfa40-c896-4567-9c2c-22e6a37c0577 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:53.300682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbfa40-c896-4567-9c2c-22e6a37c0577 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:53.383757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 597/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:28:53 2022] POST /identity/v3/users => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:28:55.323384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385666-da77-4d68-8d07-9d69771aa7bc None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:55.323930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385666-da77-4d68-8d07-9d69771aa7bc None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:55.323930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385666-da77-4d68-8d07-9d69771aa7bc None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:55.325305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 581/1178] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:55.330734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5fe1-9be9-436a-a8dc-72ff80da20b0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:55.331141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5fe1-9be9-436a-a8dc-72ff80da20b0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:55.331416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5fe1-9be9-436a-a8dc-72ff80da20b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:55.338617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:55.349753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f10c5fe1-9be9-436a-a8dc-72ff80da20b0 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:55.360250 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f10c5fe1-9be9-436a-a8dc-72ff80da20b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:55.416404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 598/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:55.688708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385666-da77-4d68-8d07-9d69771aa7bc None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:55.716511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:55.789058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385666-da77-4d68-8d07-9d69771aa7bc None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:55.821050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86fbcb-e811-44a1-84bd-5e20846f870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:55.821807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fbcb-e811-44a1-84bd-5e20846f870b None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:55.822100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fbcb-e811-44a1-84bd-5e20846f870b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:55.822403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fbcb-e811-44a1-84bd-5e20846f870b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:55.833095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86fbcb-e811-44a1-84bd-5e20846f870b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-1a86fbcb-e811-44a1-84bd-5e20846f870b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:55.837670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:55.838870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:55.840052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 582/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:55.845369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5fe1-9be9-436a-a8dc-72ff80da20b0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:55.941135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5fe1-9be9-436a-a8dc-72ff80da20b0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:55.974530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ebd3a-f870-471c-9da1-6e1082eba15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:55.975138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ebd3a-f870-471c-9da1-6e1082eba15a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:55.975427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ebd3a-f870-471c-9da1-6e1082eba15a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:55.975708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ebd3a-f870-471c-9da1-6e1082eba15a None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:55.976372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ebd3a-f870-471c-9da1-6e1082eba15a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:55.976687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ebd3a-f870-471c-9da1-6e1082eba15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:55.978064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ebd3a-f870-471c-9da1-6e1082eba15a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:55.979428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:55.986567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 599/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:55.992249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86fbcb-e811-44a1-84bd-5e20846f870b None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:56.077113 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:56.091436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86fbcb-e811-44a1-84bd-5e20846f870b None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:56.124856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ca36f-d8d6-435e-8c6f-6962dd58d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:56.125567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca36f-d8d6-435e-8c6f-6962dd58d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:56.125853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca36f-d8d6-435e-8c6f-6962dd58d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:56.126132 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca36f-d8d6-435e-8c6f-6962dd58d8d6 None admin] PATH_INFO: `/v3/users/f1c120bca7da4c548a172aef82cf6b48` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:56.138904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ca36f-d8d6-435e-8c6f-6962dd58d8d6 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c120bca7da4c548a172aef82cf6b48)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:56.140346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ca36f-d8d6-435e-8c6f-6962dd58d8d6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:56.142058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 583/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:55 2022] GET /identity/v3/users/f1c120bca7da4c548a172aef82cf6b48 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:56.147948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ebd3a-f870-471c-9da1-6e1082eba15a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:56.246145 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ebd3a-f870-471c-9da1-6e1082eba15a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:56.277644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f2d44-ccfb-4763-a038-9d5c62a2513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:56.278263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f2d44-ccfb-4763-a038-9d5c62a2513c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:56.278545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f2d44-ccfb-4763-a038-9d5c62a2513c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:56.278817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f2d44-ccfb-4763-a038-9d5c62a2513c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:56.337789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:56.344547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f2d44-ccfb-4763-a038-9d5c62a2513c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:56.345985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f2d44-ccfb-4763-a038-9d5c62a2513c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:56.439229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 600/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:56.445528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ca36f-d8d6-435e-8c6f-6962dd58d8d6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:56.542425 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ca36f-d8d6-435e-8c6f-6962dd58d8d6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:56.575658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3c0b0-e46d-446a-9579-07d317e29670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:56.576267 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3c0b0-e46d-446a-9579-07d317e29670 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:56.576545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3c0b0-e46d-446a-9579-07d317e29670 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:56.576816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3c0b0-e46d-446a-9579-07d317e29670 None admin] PATH_INFO: `/v3/projects/810451bc59e74cf88b7152ee4ca3bdf2` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:56.577917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3c0b0-e46d-446a-9579-07d317e29670 None admin] RBAC: Authorizing `identity:get_project(project_id=810451bc59e74cf88b7152ee4ca3bdf2)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:56.580227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3c0b0-e46d-446a-9579-07d317e29670 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:56.581823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 584/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:56 2022] GET /identity/v3/projects/810451bc59e74cf88b7152ee4ca3bdf2 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:56.587828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f2d44-ccfb-4763-a038-9d5c62a2513c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:56.680295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:56.685748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f2d44-ccfb-4763-a038-9d5c62a2513c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:56.719252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa86d4-96d8-4fb3-94b9-329c67d9473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:56.719846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa86d4-96d8-4fb3-94b9-329c67d9473f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:56.720128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa86d4-96d8-4fb3-94b9-329c67d9473f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:56.720404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa86d4-96d8-4fb3-94b9-329c67d9473f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:56.721117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa86d4-96d8-4fb3-94b9-329c67d9473f None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=810451bc59e74cf88b7152ee4ca3bdf2, user.id=f1c120bca7da4c548a172aef82cf6b48) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:56.721425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa86d4-96d8-4fb3-94b9-329c67d9473f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:56.722890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa86d4-96d8-4fb3-94b9-329c67d9473f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:56.728065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 601/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:56 2022] GET /identity/v3/role_assignments?user.id=f1c120bca7da4c548a172aef82cf6b48&scope.project.id=810451bc59e74cf88b7152ee4ca3bdf2&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:58.607457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf7bfe-0751-4699-88f1-7defabd7277c None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:58.607993 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf7bfe-0751-4699-88f1-7defabd7277c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:58.607993 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf7bfe-0751-4699-88f1-7defabd7277c None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:58.609379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 585/1186] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:58.615441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61b432-9634-4c18-89f1-4eb00aefd275 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:58.615876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61b432-9634-4c18-89f1-4eb00aefd275 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:58.615985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61b432-9634-4c18-89f1-4eb00aefd275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:58.635877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7c61b432-9634-4c18-89f1-4eb00aefd275 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:58.637101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7c61b432-9634-4c18-89f1-4eb00aefd275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:58.701768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 602/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:58.971768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf7bfe-0751-4699-88f1-7defabd7277c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:58.986868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:59.071913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf7bfe-0751-4699-88f1-7defabd7277c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:59.104706 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ca101-10f4-4a4e-8539-643e32409b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:59.105320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca101-10f4-4a4e-8539-643e32409b45 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:59.105603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca101-10f4-4a4e-8539-643e32409b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:59.105884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca101-10f4-4a4e-8539-643e32409b45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:59.116332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ca101-10f4-4a4e-8539-643e32409b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-3c0ca101-10f4-4a4e-8539-643e32409b45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:59.120953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:59.122043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:28:59.122981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 586/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:59.128018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61b432-9634-4c18-89f1-4eb00aefd275 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:59.216012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:59.227929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61b432-9634-4c18-89f1-4eb00aefd275 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:59.259439 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ae267-6fa6-42c7-9c43-914a758133b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:59.260040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ae267-6fa6-42c7-9c43-914a758133b5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:59.260319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ae267-6fa6-42c7-9c43-914a758133b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:59.260591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ae267-6fa6-42c7-9c43-914a758133b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:59.261243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ae267-6fa6-42c7-9c43-914a758133b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:59.261546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ae267-6fa6-42c7-9c43-914a758133b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:59.262935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ae267-6fa6-42c7-9c43-914a758133b5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:59.271309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 603/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:59.277130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ca101-10f4-4a4e-8539-643e32409b45 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:59.346756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:59.374503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ca101-10f4-4a4e-8539-643e32409b45 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:59.410148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30828084-0325-489c-a5d2-2f770cea8158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:59.410787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30828084-0325-489c-a5d2-2f770cea8158 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:59.411072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30828084-0325-489c-a5d2-2f770cea8158 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:59.411350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30828084-0325-489c-a5d2-2f770cea8158 None admin] PATH_INFO: `/v3/users/f1c120bca7da4c548a172aef82cf6b48` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:59.412461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30828084-0325-489c-a5d2-2f770cea8158 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c120bca7da4c548a172aef82cf6b48)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:59.413896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30828084-0325-489c-a5d2-2f770cea8158 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:59.415486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 587/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:59 2022] GET /identity/v3/users/f1c120bca7da4c548a172aef82cf6b48 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:59.421154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ae267-6fa6-42c7-9c43-914a758133b5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:59.521095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ae267-6fa6-42c7-9c43-914a758133b5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:59.553820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da3de5-7be7-448c-843f-0b3303a0f097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:59.554458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da3de5-7be7-448c-843f-0b3303a0f097 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:59.554741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da3de5-7be7-448c-843f-0b3303a0f097 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:59.555015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da3de5-7be7-448c-843f-0b3303a0f097 None admin] PATH_INFO: `/v3/projects/810451bc59e74cf88b7152ee4ca3bdf2` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:59.556102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da3de5-7be7-448c-843f-0b3303a0f097 None admin] RBAC: Authorizing `identity:get_project(project_id=810451bc59e74cf88b7152ee4ca3bdf2)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:59.557610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da3de5-7be7-448c-843f-0b3303a0f097 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:59.559214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 604/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:59 2022] GET /identity/v3/projects/810451bc59e74cf88b7152ee4ca3bdf2 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:59.565918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30828084-0325-489c-a5d2-2f770cea8158 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:59.661029 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30828084-0325-489c-a5d2-2f770cea8158 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:59.694073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21b7b0-b395-40f8-b1c2-16d5e1220a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:59.694735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21b7b0-b395-40f8-b1c2-16d5e1220a6b None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:59.695014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21b7b0-b395-40f8-b1c2-16d5e1220a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:59.695286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21b7b0-b395-40f8-b1c2-16d5e1220a6b None admin] PATH_INFO: `/v3/projects/810451bc59e74cf88b7152ee4ca3bdf2/users/f1c120bca7da4c548a172aef82cf6b48/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:59.697127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21b7b0-b395-40f8-b1c2-16d5e1220a6b None admin] RBAC: Authorizing `identity:create_grant(project_id=810451bc59e74cf88b7152ee4ca3bdf2, user_id=f1c120bca7da4c548a172aef82cf6b48, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:59.698579 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21b7b0-b395-40f8-b1c2-16d5e1220a6b None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:59.789287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:59.793511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 588/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:28:59 2022] PUT /identity/v3/projects/810451bc59e74cf88b7152ee4ca3bdf2/users/f1c120bca7da4c548a172aef82cf6b48/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:29:01.668485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d79c-151c-4a60-93ce-7b9eab039a53 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:29:01.669033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d79c-151c-4a60-93ce-7b9eab039a53 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:29:01.669033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d79c-151c-4a60-93ce-7b9eab039a53 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:29:01.670441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 605/1193] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:29:01.676347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd174dd2-a88b-4a61-94c7-cca1234e3aa1 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:29:01.676780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd174dd2-a88b-4a61-94c7-cca1234e3aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:29:01.676885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd174dd2-a88b-4a61-94c7-cca1234e3aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:29:01.694767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-bd174dd2-a88b-4a61-94c7-cca1234e3aa1 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:29:01.695946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bd174dd2-a88b-4a61-94c7-cca1234e3aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:29:01.760265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 589/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:29:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:29:02.031464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d79c-151c-4a60-93ce-7b9eab039a53 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:29:02.053763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:29:02.133842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d79c-151c-4a60-93ce-7b9eab039a53 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:29:02.166664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b64a9-0616-44cb-9953-cb2f30a2bd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:29:02.167293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b64a9-0616-44cb-9953-cb2f30a2bd3e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:29:02.167578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b64a9-0616-44cb-9953-cb2f30a2bd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:29:02.167861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b64a9-0616-44cb-9953-cb2f30a2bd3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:29:02.179504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b64a9-0616-44cb-9953-cb2f30a2bd3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f04b64a9-0616-44cb-9953-cb2f30a2bd3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:29:02.184378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:29:02.185394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:29:02.186739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 606/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:29:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:29:02.191990 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd174dd2-a88b-4a61-94c7-cca1234e3aa1 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:29:02.288331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd174dd2-a88b-4a61-94c7-cca1234e3aa1 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:29:02.317004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:29:02.322525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a283d2-e9b7-4179-9529-7613aa0ccfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:29:02.323127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a283d2-e9b7-4179-9529-7613aa0ccfdd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:29:02.323403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a283d2-e9b7-4179-9529-7613aa0ccfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:29:02.323670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a283d2-e9b7-4179-9529-7613aa0ccfdd None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:29:02.324323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a283d2-e9b7-4179-9529-7613aa0ccfdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:29:02.324622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a283d2-e9b7-4179-9529-7613aa0ccfdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:29:02.325984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a283d2-e9b7-4179-9529-7613aa0ccfdd None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:29:02.334855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 590/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:29:02.340779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b64a9-0616-44cb-9953-cb2f30a2bd3e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:29:02.419805 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:29:02.438275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b64a9-0616-44cb-9953-cb2f30a2bd3e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:29:02.472801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bb17d-e1a7-4b78-b16d-a8ecddcb80ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:29:02.473435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bb17d-e1a7-4b78-b16d-a8ecddcb80ed None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:29:02.473720 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bb17d-e1a7-4b78-b16d-a8ecddcb80ed None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:29:02.474003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bb17d-e1a7-4b78-b16d-a8ecddcb80ed None admin] PATH_INFO: `/v3/users/f1c120bca7da4c548a172aef82cf6b48` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:29:02.475151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bb17d-e1a7-4b78-b16d-a8ecddcb80ed None admin] RBAC: Authorizing `identity:get_user(user_id=f1c120bca7da4c548a172aef82cf6b48)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:29:02.476592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bb17d-e1a7-4b78-b16d-a8ecddcb80ed None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:29:02.478271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 607/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 22 12:29:02 2022] GET /identity/v3/users/f1c120bca7da4c548a172aef82cf6b48 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:29:02.484095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a283d2-e9b7-4179-9529-7613aa0ccfdd None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:29:02.584842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a283d2-e9b7-4179-9529-7613aa0ccfdd None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:29:02.618331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d5980-cf6f-4ef1-86db-390e3229ee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:29:02.618931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d5980-cf6f-4ef1-86db-390e3229ee8d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:29:02.619213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d5980-cf6f-4ef1-86db-390e3229ee8d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:29:02.619488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d5980-cf6f-4ef1-86db-390e3229ee8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:29:02.676781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:29:02.685837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d5980-cf6f-4ef1-86db-390e3229ee8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:29:02.692265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d5980-cf6f-4ef1-86db-390e3229ee8d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:29:02.783277 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 591/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:29:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:29:02.789179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bb17d-e1a7-4b78-b16d-a8ecddcb80ed None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:29:02.887855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bb17d-e1a7-4b78-b16d-a8ecddcb80ed None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:29:02.920572 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0e079-a194-465e-bf85-ef7e9f18cd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:29:02.921212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e079-a194-465e-bf85-ef7e9f18cd7c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:29:02.921499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e079-a194-465e-bf85-ef7e9f18cd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:29:02.922918 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e079-a194-465e-bf85-ef7e9f18cd7c None admin] PATH_INFO: `/v3/projects/810451bc59e74cf88b7152ee4ca3bdf2` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:29:02.924056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0e079-a194-465e-bf85-ef7e9f18cd7c None admin] RBAC: Authorizing `identity:get_project(project_id=810451bc59e74cf88b7152ee4ca3bdf2)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:29:02.925502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0e079-a194-465e-bf85-ef7e9f18cd7c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:29:02.927151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 608/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 22 12:29:02 2022] GET /identity/v3/projects/810451bc59e74cf88b7152ee4ca3bdf2 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:29:02.933313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d5980-cf6f-4ef1-86db-390e3229ee8d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:29:03.025289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:29:03.034180 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d5980-cf6f-4ef1-86db-390e3229ee8d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:29:03.068045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32636b92-f7f1-441e-9ef9-aff485440067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:29:03.068634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32636b92-f7f1-441e-9ef9-aff485440067 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:29:03.068911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32636b92-f7f1-441e-9ef9-aff485440067 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:29:03.069179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32636b92-f7f1-441e-9ef9-aff485440067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:29:03.069888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32636b92-f7f1-441e-9ef9-aff485440067 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=810451bc59e74cf88b7152ee4ca3bdf2, user.id=f1c120bca7da4c548a172aef82cf6b48) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:29:03.070210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32636b92-f7f1-441e-9ef9-aff485440067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:29:03.071632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32636b92-f7f1-441e-9ef9-aff485440067 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:29:03.077130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 592/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:29:02 2022] GET /identity/v3/role_assignments?user.id=f1c120bca7da4c548a172aef82cf6b48&scope.project.id=810451bc59e74cf88b7152ee4ca3bdf2&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:29:12.916451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:29:13.074616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=22 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:21.714060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7250a-9ded-4981-b6aa-f6dd5748c2b1 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:21.714674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7250a-9ded-4981-b6aa-f6dd5748c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:21.714674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7250a-9ded-4981-b6aa-f6dd5748c2b1 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:21.716022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 609/1201] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:21.721373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e43ae-a58e-47dd-b82f-3edcb98f5e42 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:21.721793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e43ae-a58e-47dd-b82f-3edcb98f5e42 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:21.722024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e43ae-a58e-47dd-b82f-3edcb98f5e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:21.740399 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-949e43ae-a58e-47dd-b82f-3edcb98f5e42 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:21.741616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-949e43ae-a58e-47dd-b82f-3edcb98f5e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:21.809809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 593/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:22.082658 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7250a-9ded-4981-b6aa-f6dd5748c2b1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:22.185864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7250a-9ded-4981-b6aa-f6dd5748c2b1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:22.220404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8643bc8-dd3d-4ec7-b729-a760e924a1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:22.221032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8643bc8-dd3d-4ec7-b729-a760e924a1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:22.221312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8643bc8-dd3d-4ec7-b729-a760e924a1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:22.221658 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8643bc8-dd3d-4ec7-b729-a760e924a1c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:22.231935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8643bc8-dd3d-4ec7-b729-a760e924a1c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:22.233410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8643bc8-dd3d-4ec7-b729-a760e924a1c3 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b8643bc8-dd3d-4ec7-b729-a760e924a1c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:22.247142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:22.248374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:22.249755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:22.249755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:22.249755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:22.249755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 610/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:22.254325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e43ae-a58e-47dd-b82f-3edcb98f5e42 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:22.354652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e43ae-a58e-47dd-b82f-3edcb98f5e42 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:22.382757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:22.389079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336757a6-9cf9-4f31-ac7e-317df311d2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:22.389666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336757a6-9cf9-4f31-ac7e-317df311d2bc None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:22.389948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336757a6-9cf9-4f31-ac7e-317df311d2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:22.390249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336757a6-9cf9-4f31-ac7e-317df311d2bc None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:22.390894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336757a6-9cf9-4f31-ac7e-317df311d2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:22.391202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336757a6-9cf9-4f31-ac7e-317df311d2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:22.392560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336757a6-9cf9-4f31-ac7e-317df311d2bc None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:22.404202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 594/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:22.410218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8643bc8-dd3d-4ec7-b729-a760e924a1c3 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:22.462841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:22.508833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8643bc8-dd3d-4ec7-b729-a760e924a1c3 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:22.541303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f5795-902c-48c2-a547-ba65e5a727e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:22.541916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f5795-902c-48c2-a547-ba65e5a727e8 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:22.542215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f5795-902c-48c2-a547-ba65e5a727e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:22.542506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f5795-902c-48c2-a547-ba65e5a727e8 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:22.543153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f5795-902c-48c2-a547-ba65e5a727e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:22.544582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f5795-902c-48c2-a547-ba65e5a727e8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:22.669498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 611/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 22 12:30:22 2022] POST /identity/v3/users => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:30:24.624047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921d25b-38f7-4eb2-8528-c485bc6aee4e None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:24.624603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921d25b-38f7-4eb2-8528-c485bc6aee4e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:24.624603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921d25b-38f7-4eb2-8528-c485bc6aee4e None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:24.625928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 595/1206] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:24.631303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6f39-3233-4f30-bf66-13b6a21e4e29 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:24.636744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6f39-3233-4f30-bf66-13b6a21e4e29 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:24.636744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6f39-3233-4f30-bf66-13b6a21e4e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:24.650741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-00ee6f39-3233-4f30-bf66-13b6a21e4e29 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:24.651951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-00ee6f39-3233-4f30-bf66-13b6a21e4e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:24.721057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 612/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:24.994833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921d25b-38f7-4eb2-8528-c485bc6aee4e None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.098523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921d25b-38f7-4eb2-8528-c485bc6aee4e None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.131633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e6a8b-543a-4403-8950-4d5aba40ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.132252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e6a8b-543a-4403-8950-4d5aba40ef40 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.132536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e6a8b-543a-4403-8950-4d5aba40ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.132808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e6a8b-543a-4403-8950-4d5aba40ef40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.143921 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e6a8b-543a-4403-8950-4d5aba40ef40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-135e6a8b-543a-4403-8950-4d5aba40ef40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:25.148534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:25.150284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:25.151302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 596/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:30:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:25.156455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee6f39-3233-4f30-bf66-13b6a21e4e29 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.199696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:25.258855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee6f39-3233-4f30-bf66-13b6a21e4e29 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.292331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248c8db-bd08-4337-84e2-27ede946b3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.292941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248c8db-bd08-4337-84e2-27ede946b3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.293221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248c8db-bd08-4337-84e2-27ede946b3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.293491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248c8db-bd08-4337-84e2-27ede946b3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.294160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248c8db-bd08-4337-84e2-27ede946b3b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:25.294491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248c8db-bd08-4337-84e2-27ede946b3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.295860 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248c8db-bd08-4337-84e2-27ede946b3b5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.304083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 613/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:25.309927 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e6a8b-543a-4403-8950-4d5aba40ef40 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.359307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:25.407384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e6a8b-543a-4403-8950-4d5aba40ef40 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.440590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc75644-4a90-46fd-8f97-2be965b16bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.441210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75644-4a90-46fd-8f97-2be965b16bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.441494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75644-4a90-46fd-8f97-2be965b16bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.441764 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75644-4a90-46fd-8f97-2be965b16bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.453726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc75644-4a90-46fd-8f97-2be965b16bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.455189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc75644-4a90-46fd-8f97-2be965b16bd4 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-9cc75644-4a90-46fd-8f97-2be965b16bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:25.469363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:25.470551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:25.471510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:25.471510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:25.471510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:25.471510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 597/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:25.476368 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248c8db-bd08-4337-84e2-27ede946b3b5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.577073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:25.579978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248c8db-bd08-4337-84e2-27ede946b3b5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.613355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12efa-4669-4e7a-a9be-a114fb5f46a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.613959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12efa-4669-4e7a-a9be-a114fb5f46a6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.614275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12efa-4669-4e7a-a9be-a114fb5f46a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.614553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12efa-4669-4e7a-a9be-a114fb5f46a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.615253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c12efa-4669-4e7a-a9be-a114fb5f46a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:25.615560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c12efa-4669-4e7a-a9be-a114fb5f46a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.616951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c12efa-4669-4e7a-a9be-a114fb5f46a6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.629028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 614/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:25.635772 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc75644-4a90-46fd-8f97-2be965b16bd4 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.734183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc75644-4a90-46fd-8f97-2be965b16bd4 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.735712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:25.768039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eadbea-e1b1-4ce2-a9fb-44565b3d09ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.768649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eadbea-e1b1-4ce2-a9fb-44565b3d09ac None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.768928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eadbea-e1b1-4ce2-a9fb-44565b3d09ac None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.769199 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eadbea-e1b1-4ce2-a9fb-44565b3d09ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.776461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eadbea-e1b1-4ce2-a9fb-44565b3d09ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.777901 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eadbea-e1b1-4ce2-a9fb-44565b3d09ac None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-48eadbea-e1b1-4ce2-a9fb-44565b3d09ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:25.788766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:25.792855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:25.794085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 598/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:25.796077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12efa-4669-4e7a-a9be-a114fb5f46a6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.894205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12efa-4669-4e7a-a9be-a114fb5f46a6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.927567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b632d07-5fe0-4c28-ac20-c5e73f919bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.928174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b632d07-5fe0-4c28-ac20-c5e73f919bcc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.928456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b632d07-5fe0-4c28-ac20-c5e73f919bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.929713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b632d07-5fe0-4c28-ac20-c5e73f919bcc None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.929713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b632d07-5fe0-4c28-ac20-c5e73f919bcc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:25.929891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b632d07-5fe0-4c28-ac20-c5e73f919bcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.931864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b632d07-5fe0-4c28-ac20-c5e73f919bcc None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.948956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 615/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:25.954800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eadbea-e1b1-4ce2-a9fb-44565b3d09ac None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:26.052694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eadbea-e1b1-4ce2-a9fb-44565b3d09ac None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:26.086153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e68a3a-2a5c-4537-9b7d-e9b3a5bce085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:26.087232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68a3a-2a5c-4537-9b7d-e9b3a5bce085 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:26.087518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68a3a-2a5c-4537-9b7d-e9b3a5bce085 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:26.087792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68a3a-2a5c-4537-9b7d-e9b3a5bce085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:26.119871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:26.156408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e68a3a-2a5c-4537-9b7d-e9b3a5bce085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:26.157778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e68a3a-2a5c-4537-9b7d-e9b3a5bce085 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:26.255934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 599/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:30:26.261825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b632d07-5fe0-4c28-ac20-c5e73f919bcc None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:26.280895 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:26.359822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b632d07-5fe0-4c28-ac20-c5e73f919bcc None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:26.392324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da824ab4-000b-477d-b099-76c27569c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:26.392946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da824ab4-000b-477d-b099-76c27569c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:26.393227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da824ab4-000b-477d-b099-76c27569c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:26.393501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da824ab4-000b-477d-b099-76c27569c6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:26.403808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da824ab4-000b-477d-b099-76c27569c6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:26.405243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da824ab4-000b-477d-b099-76c27569c6b2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-da824ab4-000b-477d-b099-76c27569c6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:26.419924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:26.421033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:26.422335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:26.422335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:26.422335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:26.422335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 616/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:26.426658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e68a3a-2a5c-4537-9b7d-e9b3a5bce085 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:26.485797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:26.522712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e68a3a-2a5c-4537-9b7d-e9b3a5bce085 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:26.555889 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a894-d92c-453e-927b-ca92e49adf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:26.556487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a894-d92c-453e-927b-ca92e49adf79 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:26.556766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a894-d92c-453e-927b-ca92e49adf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:26.557037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a894-d92c-453e-927b-ca92e49adf79 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:26.557667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a894-d92c-453e-927b-ca92e49adf79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:26.557969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a894-d92c-453e-927b-ca92e49adf79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:26.559376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a894-d92c-453e-927b-ca92e49adf79 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:26.570527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 600/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:26.577007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da824ab4-000b-477d-b099-76c27569c6b2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:26.648391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:26.679234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da824ab4-000b-477d-b099-76c27569c6b2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:26.712247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a7757-c6bd-4abd-9ca8-66a2540453cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:26.712875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a7757-c6bd-4abd-9ca8-66a2540453cd None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:26.717361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a7757-c6bd-4abd-9ca8-66a2540453cd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:26.717361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a7757-c6bd-4abd-9ca8-66a2540453cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:26.720017 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a7757-c6bd-4abd-9ca8-66a2540453cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:26.721474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a7757-c6bd-4abd-9ca8-66a2540453cd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-445a7757-c6bd-4abd-9ca8-66a2540453cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:26.733308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:26.735594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:26.736845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:26.736845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:26.736845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:26.736845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:26.736845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:26.736845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:26.736845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:26.736845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:26.736845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 617/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:26.740600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a894-d92c-453e-927b-ca92e49adf79 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:26.841667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a894-d92c-453e-927b-ca92e49adf79 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:26.864004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:26.875875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805345-4617-484b-a995-e8a8d1e7a3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:26.876477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805345-4617-484b-a995-e8a8d1e7a3cd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:26.876760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805345-4617-484b-a995-e8a8d1e7a3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:26.877035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805345-4617-484b-a995-e8a8d1e7a3cd None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:26.877716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad805345-4617-484b-a995-e8a8d1e7a3cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:26.878026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad805345-4617-484b-a995-e8a8d1e7a3cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:26.879530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad805345-4617-484b-a995-e8a8d1e7a3cd None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:26.891108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 601/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:26.897266 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a7757-c6bd-4abd-9ca8-66a2540453cd None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:27.001447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a7757-c6bd-4abd-9ca8-66a2540453cd None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:27.029020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:27.034780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd471fa0-15e3-419f-9ca6-c310dcccd0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:27.035387 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471fa0-15e3-419f-9ca6-c310dcccd0ab None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:27.035675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471fa0-15e3-419f-9ca6-c310dcccd0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:27.035952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471fa0-15e3-419f-9ca6-c310dcccd0ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:27.036684 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd471fa0-15e3-419f-9ca6-c310dcccd0ab None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=6fa8495c97df48f18b10039584d52f8a) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:27.036987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd471fa0-15e3-419f-9ca6-c310dcccd0ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:27.038464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd471fa0-15e3-419f-9ca6-c310dcccd0ab None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:27.044383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 618/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:30:26 2022] GET /identity/v3/role_assignments?user.id=6fa8495c97df48f18b10039584d52f8a&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:28.925193 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2b328-f668-4062-8364-5cc15f486ed2 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:28.925753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2b328-f668-4062-8364-5cc15f486ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:28.925753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2b328-f668-4062-8364-5cc15f486ed2 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:28.927108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 602/1220] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:28.933040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6e35-2383-4cf0-8445-c31c3487cbd6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:28.939365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6e35-2383-4cf0-8445-c31c3487cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:28.939365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6e35-2383-4cf0-8445-c31c3487cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:28.951853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b9da6e35-2383-4cf0-8445-c31c3487cbd6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:28.953026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b9da6e35-2383-4cf0-8445-c31c3487cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:29.019060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 619/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:29.290691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2b328-f668-4062-8364-5cc15f486ed2 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:29.389727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2b328-f668-4062-8364-5cc15f486ed2 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:29.423148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87705915-b380-4984-b864-01b4ad960c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:29.423792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705915-b380-4984-b864-01b4ad960c0a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:29.424071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705915-b380-4984-b864-01b4ad960c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:29.424342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705915-b380-4984-b864-01b4ad960c0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:29.434222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87705915-b380-4984-b864-01b4ad960c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-87705915-b380-4984-b864-01b4ad960c0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:29.438823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:29.443867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:29.444905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 603/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:30:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:29.446412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6e35-2383-4cf0-8445-c31c3487cbd6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:29.544844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6e35-2383-4cf0-8445-c31c3487cbd6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:29.567501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:29.578114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1334dd9-cb75-4e1e-a0a8-4bab792417de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:29.578815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1334dd9-cb75-4e1e-a0a8-4bab792417de None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:29.579097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1334dd9-cb75-4e1e-a0a8-4bab792417de None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:29.579367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1334dd9-cb75-4e1e-a0a8-4bab792417de None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:29.580017 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1334dd9-cb75-4e1e-a0a8-4bab792417de None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:29.580320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1334dd9-cb75-4e1e-a0a8-4bab792417de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:29.581687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1334dd9-cb75-4e1e-a0a8-4bab792417de None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:29.589879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 620/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:30:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:29.595674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87705915-b380-4984-b864-01b4ad960c0a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:29.639733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:29.694456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87705915-b380-4984-b864-01b4ad960c0a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:29.727996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c02d5c-7181-4729-978d-078cdfbb0a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:29.728735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c02d5c-7181-4729-978d-078cdfbb0a49 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:29.729016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c02d5c-7181-4729-978d-078cdfbb0a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:29.729288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c02d5c-7181-4729-978d-078cdfbb0a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:29.738929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c02d5c-7181-4729-978d-078cdfbb0a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:29.740347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c02d5c-7181-4729-978d-078cdfbb0a49 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-71c02d5c-7181-4729-978d-078cdfbb0a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:29.754559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:29.756710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:29.757859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:29.757859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:29.757859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:29.757859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 604/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:29.762070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1334dd9-cb75-4e1e-a0a8-4bab792417de None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:29.860845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1334dd9-cb75-4e1e-a0a8-4bab792417de None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:29.894032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58480020-d5ae-4bed-8b4c-a7225a309b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:29.894669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58480020-d5ae-4bed-8b4c-a7225a309b9d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:29.894954 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58480020-d5ae-4bed-8b4c-a7225a309b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:29.895232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58480020-d5ae-4bed-8b4c-a7225a309b9d None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:29.895869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58480020-d5ae-4bed-8b4c-a7225a309b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:29.896177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58480020-d5ae-4bed-8b4c-a7225a309b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:29.897591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58480020-d5ae-4bed-8b4c-a7225a309b9d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:29.909827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 621/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:29.915445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c02d5c-7181-4729-978d-078cdfbb0a49 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.011867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:30.018539 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c02d5c-7181-4729-978d-078cdfbb0a49 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:30.051400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d05f3a-4611-48b9-a85e-b16632ab3dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:30.052026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d05f3a-4611-48b9-a85e-b16632ab3dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:30.052309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d05f3a-4611-48b9-a85e-b16632ab3dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:30.052583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d05f3a-4611-48b9-a85e-b16632ab3dd4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:30.060550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d05f3a-4611-48b9-a85e-b16632ab3dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:30.062074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d05f3a-4611-48b9-a85e-b16632ab3dd4 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-b5d05f3a-4611-48b9-a85e-b16632ab3dd4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:30.074864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:30.076005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:30.077369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 605/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:30.081806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58480020-d5ae-4bed-8b4c-a7225a309b9d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.130925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:30.183128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58480020-d5ae-4bed-8b4c-a7225a309b9d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:30.217158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49412d64-350b-4e21-b998-8637268cefa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:30.217759 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412d64-350b-4e21-b998-8637268cefa2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:30.220089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412d64-350b-4e21-b998-8637268cefa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:30.220089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412d64-350b-4e21-b998-8637268cefa2 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:30.220089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49412d64-350b-4e21-b998-8637268cefa2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:30.220089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49412d64-350b-4e21-b998-8637268cefa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:30.220834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49412d64-350b-4e21-b998-8637268cefa2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:30.237446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 622/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:30.243236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d05f3a-4611-48b9-a85e-b16632ab3dd4 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.341325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d05f3a-4611-48b9-a85e-b16632ab3dd4 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:30.374777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2589e9-ff40-40ef-a525-0f8728d71758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:30.375393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2589e9-ff40-40ef-a525-0f8728d71758 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:30.381555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2589e9-ff40-40ef-a525-0f8728d71758 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:30.381555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2589e9-ff40-40ef-a525-0f8728d71758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:30.386264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2589e9-ff40-40ef-a525-0f8728d71758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:30.387694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2589e9-ff40-40ef-a525-0f8728d71758 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-9d2589e9-ff40-40ef-a525-0f8728d71758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:30.401327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:30.402487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:30.403877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:30.403877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:30.403877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:30.403877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 606/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:30.408252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49412d64-350b-4e21-b998-8637268cefa2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.508517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49412d64-350b-4e21-b998-8637268cefa2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:30.510929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:30.542657 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd1017-9c6f-4fa4-9d57-c53d670248cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:30.543263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1017-9c6f-4fa4-9d57-c53d670248cc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:30.543545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1017-9c6f-4fa4-9d57-c53d670248cc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:30.543817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1017-9c6f-4fa4-9d57-c53d670248cc None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:30.544450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd1017-9c6f-4fa4-9d57-c53d670248cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:30.544750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd1017-9c6f-4fa4-9d57-c53d670248cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:30.546112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd1017-9c6f-4fa4-9d57-c53d670248cc None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:30.558798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 623/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:30.564494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2589e9-ff40-40ef-a525-0f8728d71758 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.574070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:30.666661 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2589e9-ff40-40ef-a525-0f8728d71758 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:30.700282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0e82-558c-4571-a5f6-28a6062269f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:30.700899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0e82-558c-4571-a5f6-28a6062269f2 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:30.701177 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0e82-558c-4571-a5f6-28a6062269f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:30.701445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0e82-558c-4571-a5f6-28a6062269f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:30.708454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e0e82-558c-4571-a5f6-28a6062269f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:30.709898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e0e82-558c-4571-a5f6-28a6062269f2 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-c72e0e82-558c-4571-a5f6-28a6062269f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:30.721483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:30.722704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:30.723656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:30.723656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:30.723656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:30.723656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:30.723656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:30.723656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:30.723656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:30.723656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:30.723656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 607/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:30.729460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd1017-9c6f-4fa4-9d57-c53d670248cc None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.834173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd1017-9c6f-4fa4-9d57-c53d670248cc None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:30.868138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b7392-6e16-4e7b-b8a3-8dd5ce86e934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:30.868777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b7392-6e16-4e7b-b8a3-8dd5ce86e934 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:30.869056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b7392-6e16-4e7b-b8a3-8dd5ce86e934 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:30.869332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b7392-6e16-4e7b-b8a3-8dd5ce86e934 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:30.870019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b7392-6e16-4e7b-b8a3-8dd5ce86e934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:30.870361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b7392-6e16-4e7b-b8a3-8dd5ce86e934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:30.871796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b7392-6e16-4e7b-b8a3-8dd5ce86e934 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:30.883722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 624/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:30.890222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0e82-558c-4571-a5f6-28a6062269f2 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.956889 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:30.990876 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0e82-558c-4571-a5f6-28a6062269f2 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:31.024403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0be576-48a6-443a-af67-b7debc69dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:31.025283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0be576-48a6-443a-af67-b7debc69dff8 None admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:31.025570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0be576-48a6-443a-af67-b7debc69dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:31.025849 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0be576-48a6-443a-af67-b7debc69dff8 None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/6fa8495c97df48f18b10039584d52f8a/roles/0cef1088535b4535b2d6d5cc17c09549` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:31.039906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0be576-48a6-443a-af67-b7debc69dff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=6fa8495c97df48f18b10039584d52f8a, role_id=0cef1088535b4535b2d6d5cc17c09549)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:31.041385 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0be576-48a6-443a-af67-b7debc69dff8 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:31.097616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 608/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:30:30 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/6fa8495c97df48f18b10039584d52f8a/roles/0cef1088535b4535b2d6d5cc17c09549 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:30:32.977317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b639d3c-896b-437a-b488-aaffda9ab562 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:32.978428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b639d3c-896b-437a-b488-aaffda9ab562 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:32.979055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b639d3c-896b-437a-b488-aaffda9ab562 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:32.980419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 625/1233] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:32.985678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32272fb-2955-4a53-a39c-d9bd73b8d778 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:32.986054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32272fb-2955-4a53-a39c-d9bd73b8d778 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:32.986249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32272fb-2955-4a53-a39c-d9bd73b8d778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.004404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-d32272fb-2955-4a53-a39c-d9bd73b8d778 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:33.005577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d32272fb-2955-4a53-a39c-d9bd73b8d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:33.069941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 609/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:33.339703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b639d3c-896b-437a-b488-aaffda9ab562 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:33.365765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:33.440179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b639d3c-896b-437a-b488-aaffda9ab562 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:33.475154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c206f16-dd0c-456e-acf9-f67d3de87f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:33.475784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c206f16-dd0c-456e-acf9-f67d3de87f56 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:33.476068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c206f16-dd0c-456e-acf9-f67d3de87f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:33.476345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c206f16-dd0c-456e-acf9-f67d3de87f56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.486220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c206f16-dd0c-456e-acf9-f67d3de87f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-0c206f16-dd0c-456e-acf9-f67d3de87f56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:33.490877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:33.497049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:33.498121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 626/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:33.500073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32272fb-2955-4a53-a39c-d9bd73b8d778 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:33.547282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:33.599558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32272fb-2955-4a53-a39c-d9bd73b8d778 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:33.632093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cf093-49b5-4573-9b5e-7008e7f677df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:33.632690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cf093-49b5-4573-9b5e-7008e7f677df None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:33.632974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cf093-49b5-4573-9b5e-7008e7f677df None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:33.633245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cf093-49b5-4573-9b5e-7008e7f677df None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.634465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cf093-49b5-4573-9b5e-7008e7f677df None admin] RBAC: Adding query filter params (name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:33.634761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cf093-49b5-4573-9b5e-7008e7f677df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:33.636119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cf093-49b5-4573-9b5e-7008e7f677df None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:33.643747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 610/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:33.649572 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c206f16-dd0c-456e-acf9-f67d3de87f56 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:33.732733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:33.748312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c206f16-dd0c-456e-acf9-f67d3de87f56 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:33.782256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d4113-4a24-42bc-963f-f0149d92119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:33.786991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d4113-4a24-42bc-963f-f0149d92119b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:33.786991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d4113-4a24-42bc-963f-f0149d92119b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:33.786991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d4113-4a24-42bc-963f-f0149d92119b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.793120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d4113-4a24-42bc-963f-f0149d92119b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:33.794583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d4113-4a24-42bc-963f-f0149d92119b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-e81d4113-4a24-42bc-963f-f0149d92119b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:33.809152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:33.810275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:33.811336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:33.811336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:33.811336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:33.811336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 627/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:33.816250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cf093-49b5-4573-9b5e-7008e7f677df None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:33.915171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cf093-49b5-4573-9b5e-7008e7f677df None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:33.923912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:33.949320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255483d7-e7df-4c49-9bf9-bd55d1f7f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:33.949932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255483d7-e7df-4c49-9bf9-bd55d1f7f525 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:33.950237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255483d7-e7df-4c49-9bf9-bd55d1f7f525 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:33.950518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255483d7-e7df-4c49-9bf9-bd55d1f7f525 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.951166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255483d7-e7df-4c49-9bf9-bd55d1f7f525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:33.951477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255483d7-e7df-4c49-9bf9-bd55d1f7f525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:33.952841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255483d7-e7df-4c49-9bf9-bd55d1f7f525 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:33.966046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 611/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:33.971699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d4113-4a24-42bc-963f-f0149d92119b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:34.072618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d4113-4a24-42bc-963f-f0149d92119b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:34.106384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ffe2d-0da5-4d2a-9721-8363e226f827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:34.107059 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffe2d-0da5-4d2a-9721-8363e226f827 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:34.107356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffe2d-0da5-4d2a-9721-8363e226f827 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:34.107630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffe2d-0da5-4d2a-9721-8363e226f827 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.110290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:34.115248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ffe2d-0da5-4d2a-9721-8363e226f827 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.116714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ffe2d-0da5-4d2a-9721-8363e226f827 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-466ffe2d-0da5-4d2a-9721-8363e226f827 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:34.128339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:34.129472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:34.130531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 628/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:34.135342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255483d7-e7df-4c49-9bf9-bd55d1f7f525 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:34.236359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255483d7-e7df-4c49-9bf9-bd55d1f7f525 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:34.270232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e06fc2-9d8c-40de-bd4b-cf2f88f0c963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:34.270863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06fc2-9d8c-40de-bd4b-cf2f88f0c963 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:34.271159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06fc2-9d8c-40de-bd4b-cf2f88f0c963 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:34.271437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06fc2-9d8c-40de-bd4b-cf2f88f0c963 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.272197 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e06fc2-9d8c-40de-bd4b-cf2f88f0c963 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:34.272506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e06fc2-9d8c-40de-bd4b-cf2f88f0c963 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.274065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e06fc2-9d8c-40de-bd4b-cf2f88f0c963 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.291652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 612/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:30:34.297594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ffe2d-0da5-4d2a-9721-8363e226f827 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:34.397925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ffe2d-0da5-4d2a-9721-8363e226f827 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:34.433027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0c04c-aa4a-4392-b9ee-0e233f807bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:34.433618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0c04c-aa4a-4392-b9ee-0e233f807bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:34.433972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0c04c-aa4a-4392-b9ee-0e233f807bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:34.434281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0c04c-aa4a-4392-b9ee-0e233f807bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.510720 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:34.517036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0c04c-aa4a-4392-b9ee-0e233f807bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.518564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0c04c-aa4a-4392-b9ee-0e233f807bf3 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.621991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 629/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:30:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:30:34.628024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e06fc2-9d8c-40de-bd4b-cf2f88f0c963 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:34.656194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:34.728657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e06fc2-9d8c-40de-bd4b-cf2f88f0c963 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:34.760982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db520f5-422f-4552-852c-6c08f1361045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:34.761605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db520f5-422f-4552-852c-6c08f1361045 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:34.761881 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db520f5-422f-4552-852c-6c08f1361045 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:34.762151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db520f5-422f-4552-852c-6c08f1361045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.771791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db520f5-422f-4552-852c-6c08f1361045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.773213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db520f5-422f-4552-852c-6c08f1361045 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-6db520f5-422f-4552-852c-6c08f1361045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:34.788421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:34.789412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:34.791954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:34.791954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:34.791954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:34.791954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 613/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:34.796512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0c04c-aa4a-4392-b9ee-0e233f807bf3 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:34.891819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:34.897333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0c04c-aa4a-4392-b9ee-0e233f807bf3 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:34.929943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71d5c-ef02-49c7-bd89-7dff2132d19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:34.930563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71d5c-ef02-49c7-bd89-7dff2132d19b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:34.930940 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71d5c-ef02-49c7-bd89-7dff2132d19b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:34.931504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71d5c-ef02-49c7-bd89-7dff2132d19b None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.931891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c71d5c-ef02-49c7-bd89-7dff2132d19b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:34.932195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c71d5c-ef02-49c7-bd89-7dff2132d19b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.933557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c71d5c-ef02-49c7-bd89-7dff2132d19b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.944501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 630/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:34.950758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db520f5-422f-4552-852c-6c08f1361045 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:35.029042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:35.049541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db520f5-422f-4552-852c-6c08f1361045 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:35.081957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42b25-0714-4b0b-b750-401de04d22a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:35.082601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42b25-0714-4b0b-b750-401de04d22a5 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:35.082880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42b25-0714-4b0b-b750-401de04d22a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:35.083149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42b25-0714-4b0b-b750-401de04d22a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:35.090431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42b25-0714-4b0b-b750-401de04d22a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:35.091855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42b25-0714-4b0b-b750-401de04d22a5 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-66d42b25-0714-4b0b-b750-401de04d22a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:35.102604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:35.125465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:35.126635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:35.126635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:35.126635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:35.126635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:35.126635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:35.126635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:35.126635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:35.126635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:35.126635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 614/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:35.127266 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71d5c-ef02-49c7-bd89-7dff2132d19b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:35.213278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71d5c-ef02-49c7-bd89-7dff2132d19b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:35.246675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621d408-991d-4f17-8e28-d6eed5cb5943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:35.247281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621d408-991d-4f17-8e28-d6eed5cb5943 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:35.247568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621d408-991d-4f17-8e28-d6eed5cb5943 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:35.247847 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621d408-991d-4f17-8e28-d6eed5cb5943 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:35.248536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621d408-991d-4f17-8e28-d6eed5cb5943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:35.248847 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621d408-991d-4f17-8e28-d6eed5cb5943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:35.250341 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621d408-991d-4f17-8e28-d6eed5cb5943 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:35.262853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 631/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:35.269090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42b25-0714-4b0b-b750-401de04d22a5 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:35.366591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42b25-0714-4b0b-b750-401de04d22a5 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:35.401096 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710eec1-195d-48e0-86d7-52bb056cc5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:35.401699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710eec1-195d-48e0-86d7-52bb056cc5cd None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:35.401981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710eec1-195d-48e0-86d7-52bb056cc5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:35.402289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710eec1-195d-48e0-86d7-52bb056cc5cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:35.403012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710eec1-195d-48e0-86d7-52bb056cc5cd None admin] RBAC: Adding query filter params (role.id=0cef1088535b4535b2d6d5cc17c09549, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=6fa8495c97df48f18b10039584d52f8a) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:35.403320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710eec1-195d-48e0-86d7-52bb056cc5cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:35.404750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710eec1-195d-48e0-86d7-52bb056cc5cd None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:35.410401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 615/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:30:35 2022] GET /identity/v3/role_assignments?user.id=6fa8495c97df48f18b10039584d52f8a&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=0cef1088535b4535b2d6d5cc17c09549 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:37.369630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7177290-6261-456f-90f6-6ca5300db164 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:37.370239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7177290-6261-456f-90f6-6ca5300db164 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:37.370239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7177290-6261-456f-90f6-6ca5300db164 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:37.371635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 632/1247] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:37.376725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6afe1-2108-4231-8100-c2e44e3548cb None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:37.377956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6afe1-2108-4231-8100-c2e44e3548cb None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:37.377956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6afe1-2108-4231-8100-c2e44e3548cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:37.383508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:37.395952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c8c6afe1-2108-4231-8100-c2e44e3548cb None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:37.397134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c8c6afe1-2108-4231-8100-c2e44e3548cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:37.463135 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 616/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:37.730071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7177290-6261-456f-90f6-6ca5300db164 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:37.748290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:37.830611 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7177290-6261-456f-90f6-6ca5300db164 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:37.864275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed6482-5395-4746-b3a9-0a83c61c090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:37.864896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6482-5395-4746-b3a9-0a83c61c090b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:37.865177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6482-5395-4746-b3a9-0a83c61c090b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:37.865448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6482-5395-4746-b3a9-0a83c61c090b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:37.875583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed6482-5395-4746-b3a9-0a83c61c090b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3eed6482-5395-4746-b3a9-0a83c61c090b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:37.882075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:37.885676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:37.886786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 633/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:30:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:37.889311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6afe1-2108-4231-8100-c2e44e3548cb None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:37.987381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6afe1-2108-4231-8100-c2e44e3548cb None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.016264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:38.021027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361ad0a-58b6-4124-ac65-31b3c11ba377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.021643 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361ad0a-58b6-4124-ac65-31b3c11ba377 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.021925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361ad0a-58b6-4124-ac65-31b3c11ba377 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.022211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361ad0a-58b6-4124-ac65-31b3c11ba377 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.022891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361ad0a-58b6-4124-ac65-31b3c11ba377 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:38.025964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361ad0a-58b6-4124-ac65-31b3c11ba377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.025964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361ad0a-58b6-4124-ac65-31b3c11ba377 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.033276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 617/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:38.039098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed6482-5395-4746-b3a9-0a83c61c090b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.116577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:38.139506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed6482-5395-4746-b3a9-0a83c61c090b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.173609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93131662-1b64-49c5-bbee-302bfd3a8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.174557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93131662-1b64-49c5-bbee-302bfd3a8e40 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.174557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93131662-1b64-49c5-bbee-302bfd3a8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.174796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93131662-1b64-49c5-bbee-302bfd3a8e40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.185994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93131662-1b64-49c5-bbee-302bfd3a8e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.188518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93131662-1b64-49c5-bbee-302bfd3a8e40 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-93131662-1b64-49c5-bbee-302bfd3a8e40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:38.204011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:38.205165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:38.206101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:38.206101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:38.206101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:38.206101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 634/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:38.211203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361ad0a-58b6-4124-ac65-31b3c11ba377 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.311394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361ad0a-58b6-4124-ac65-31b3c11ba377 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.344360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dd7c2-96f0-4b26-b223-4fd5eddda0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.344957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd7c2-96f0-4b26-b223-4fd5eddda0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.345228 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd7c2-96f0-4b26-b223-4fd5eddda0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.345500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd7c2-96f0-4b26-b223-4fd5eddda0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.346127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dd7c2-96f0-4b26-b223-4fd5eddda0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:38.346456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dd7c2-96f0-4b26-b223-4fd5eddda0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.347800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dd7c2-96f0-4b26-b223-4fd5eddda0c4 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.359792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 618/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:38.365654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93131662-1b64-49c5-bbee-302bfd3a8e40 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.465666 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93131662-1b64-49c5-bbee-302bfd3a8e40 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.491411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:38.499770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09139d-b61a-43c6-a04a-73dc7d2f3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.500399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09139d-b61a-43c6-a04a-73dc7d2f3456 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.500687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09139d-b61a-43c6-a04a-73dc7d2f3456 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.500966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09139d-b61a-43c6-a04a-73dc7d2f3456 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.508491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09139d-b61a-43c6-a04a-73dc7d2f3456 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.510526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09139d-b61a-43c6-a04a-73dc7d2f3456 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-ed09139d-b61a-43c6-a04a-73dc7d2f3456 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:38.521474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:38.530938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:38.532024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 635/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:38.532639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dd7c2-96f0-4b26-b223-4fd5eddda0c4 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.583756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:38.626905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dd7c2-96f0-4b26-b223-4fd5eddda0c4 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.660056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8b45b-069a-4bad-9d17-0064ce185979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.660659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8b45b-069a-4bad-9d17-0064ce185979 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.660941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8b45b-069a-4bad-9d17-0064ce185979 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.661216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8b45b-069a-4bad-9d17-0064ce185979 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.662069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8b45b-069a-4bad-9d17-0064ce185979 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:38.662430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8b45b-069a-4bad-9d17-0064ce185979 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.663916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8b45b-069a-4bad-9d17-0064ce185979 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.682054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 619/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:38.687772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09139d-b61a-43c6-a04a-73dc7d2f3456 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.788358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09139d-b61a-43c6-a04a-73dc7d2f3456 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.822816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925600dd-75c0-4f9a-8c08-0d07dbdd928d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.823429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925600dd-75c0-4f9a-8c08-0d07dbdd928d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.823715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925600dd-75c0-4f9a-8c08-0d07dbdd928d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.823991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925600dd-75c0-4f9a-8c08-0d07dbdd928d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.878910 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:38.890902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925600dd-75c0-4f9a-8c08-0d07dbdd928d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.892361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925600dd-75c0-4f9a-8c08-0d07dbdd928d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.987579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 636/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:30:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:30:38.993610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8b45b-069a-4bad-9d17-0064ce185979 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:39.091070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8b45b-069a-4bad-9d17-0064ce185979 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:39.104436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:39.125041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23519748-0b14-4291-b24e-71757f4905e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:39.125672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23519748-0b14-4291-b24e-71757f4905e1 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:39.125969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23519748-0b14-4291-b24e-71757f4905e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:39.126284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23519748-0b14-4291-b24e-71757f4905e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:39.136446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23519748-0b14-4291-b24e-71757f4905e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:39.137827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23519748-0b14-4291-b24e-71757f4905e1 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-23519748-0b14-4291-b24e-71757f4905e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:39.152837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:39.156567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:39.157717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:39.157717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:39.157717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:39.157717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 620/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:39.159770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925600dd-75c0-4f9a-8c08-0d07dbdd928d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:39.246505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:39.257888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925600dd-75c0-4f9a-8c08-0d07dbdd928d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:39.291247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20454db-267e-4f89-aa91-040ae7c5ea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:39.291723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20454db-267e-4f89-aa91-040ae7c5ea5b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:39.292006 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20454db-267e-4f89-aa91-040ae7c5ea5b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:39.292283 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20454db-267e-4f89-aa91-040ae7c5ea5b None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:39.292915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20454db-267e-4f89-aa91-040ae7c5ea5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:39.293221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20454db-267e-4f89-aa91-040ae7c5ea5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:39.294653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20454db-267e-4f89-aa91-040ae7c5ea5b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:39.305320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 637/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:39.311176 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23519748-0b14-4291-b24e-71757f4905e1 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:39.410533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23519748-0b14-4291-b24e-71757f4905e1 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:39.443956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e93a45-76c6-4377-b396-a0982615db4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:39.444583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e93a45-76c6-4377-b396-a0982615db4a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:39.444854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e93a45-76c6-4377-b396-a0982615db4a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:39.445123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e93a45-76c6-4377-b396-a0982615db4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:39.452364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e93a45-76c6-4377-b396-a0982615db4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:39.453780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e93a45-76c6-4377-b396-a0982615db4a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-01e93a45-76c6-4377-b396-a0982615db4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:39.465502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:39.468508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:39.470619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:39.470619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:39.470619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:39.470619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:39.470619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:39.470619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:39.470619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:39.470619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:39.470619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 621/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:39.474416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20454db-267e-4f89-aa91-040ae7c5ea5b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:39.573221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20454db-267e-4f89-aa91-040ae7c5ea5b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:39.605624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b75ecf-a219-431b-8cd5-8eb69dfa15ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:39.606265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b75ecf-a219-431b-8cd5-8eb69dfa15ce None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:39.606547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b75ecf-a219-431b-8cd5-8eb69dfa15ce None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:39.606821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b75ecf-a219-431b-8cd5-8eb69dfa15ce None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:39.607507 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b75ecf-a219-431b-8cd5-8eb69dfa15ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:39.607809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b75ecf-a219-431b-8cd5-8eb69dfa15ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:39.609236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b75ecf-a219-431b-8cd5-8eb69dfa15ce None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:39.620747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 638/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:39.626965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e93a45-76c6-4377-b396-a0982615db4a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:39.653646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:39.728700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e93a45-76c6-4377-b396-a0982615db4a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:39.763846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da157f56-f5bf-494f-9ade-42ea547b9dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:39.764449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157f56-f5bf-494f-9ade-42ea547b9dde None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:39.764751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157f56-f5bf-494f-9ade-42ea547b9dde None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:39.765012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157f56-f5bf-494f-9ade-42ea547b9dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:39.765735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da157f56-f5bf-494f-9ade-42ea547b9dde None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=6fa8495c97df48f18b10039584d52f8a) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:39.766046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da157f56-f5bf-494f-9ade-42ea547b9dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:39.767507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da157f56-f5bf-494f-9ade-42ea547b9dde None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:39.772835 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 622/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:30:39 2022] GET /identity/v3/role_assignments?user.id=6fa8495c97df48f18b10039584d52f8a&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:41.632435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e7e48-0b6c-4bb5-898a-1839c4f8a4f9 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:41.633100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e7e48-0b6c-4bb5-898a-1839c4f8a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:41.633100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e7e48-0b6c-4bb5-898a-1839c4f8a4f9 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:41.634962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 639/1261] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:41.640114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe427b-4915-4733-9f8f-579753766e81 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:41.640532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe427b-4915-4733-9f8f-579753766e81 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:41.640649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe427b-4915-4733-9f8f-579753766e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:41.659024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6abe427b-4915-4733-9f8f-579753766e81 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:41.660194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6abe427b-4915-4733-9f8f-579753766e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:41.725332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 623/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:30:41.999831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e7e48-0b6c-4bb5-898a-1839c4f8a4f9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:42.011233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.101058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e7e48-0b6c-4bb5-898a-1839c4f8a4f9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.133559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2dbe6-7e8a-4898-98c9-6dc5864d41b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.134785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2dbe6-7e8a-4898-98c9-6dc5864d41b4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.135067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2dbe6-7e8a-4898-98c9-6dc5864d41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.135338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2dbe6-7e8a-4898-98c9-6dc5864d41b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.145060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2dbe6-7e8a-4898-98c9-6dc5864d41b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f2d2dbe6-7e8a-4898-98c9-6dc5864d41b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:42.151055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:42.152268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:42.154381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 640/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:30:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:42.158304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe427b-4915-4733-9f8f-579753766e81 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:42.177648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.257099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe427b-4915-4733-9f8f-579753766e81 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.291326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0733c-acfa-4fa4-8bc5-bfb0c97bc5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.291957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0733c-acfa-4fa4-8bc5-bfb0c97bc5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.299218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0733c-acfa-4fa4-8bc5-bfb0c97bc5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.299218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0733c-acfa-4fa4-8bc5-bfb0c97bc5d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.299218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0733c-acfa-4fa4-8bc5-bfb0c97bc5d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:42.299218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0733c-acfa-4fa4-8bc5-bfb0c97bc5d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:42.299218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0733c-acfa-4fa4-8bc5-bfb0c97bc5d0 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:42.302686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 624/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:42.309038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2dbe6-7e8a-4898-98c9-6dc5864d41b4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:42.375702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.408590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2dbe6-7e8a-4898-98c9-6dc5864d41b4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.441413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d174f20-069b-4570-825d-69815fc0a095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.442034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d174f20-069b-4570-825d-69815fc0a095 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.442340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d174f20-069b-4570-825d-69815fc0a095 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.442616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d174f20-069b-4570-825d-69815fc0a095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.453022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d174f20-069b-4570-825d-69815fc0a095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:42.454494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d174f20-069b-4570-825d-69815fc0a095 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-2d174f20-069b-4570-825d-69815fc0a095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:42.468426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:42.472134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:42.473289 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:42.473289 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:42.473289 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:42.473289 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 641/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:42.475338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0733c-acfa-4fa4-8bc5-bfb0c97bc5d0 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:42.557873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.576115 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0733c-acfa-4fa4-8bc5-bfb0c97bc5d0 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.608359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca728773-6b77-4a92-bc1d-5e93782a7b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.608958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca728773-6b77-4a92-bc1d-5e93782a7b04 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.609234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca728773-6b77-4a92-bc1d-5e93782a7b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.609504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca728773-6b77-4a92-bc1d-5e93782a7b04 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.610127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca728773-6b77-4a92-bc1d-5e93782a7b04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:42.610454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca728773-6b77-4a92-bc1d-5e93782a7b04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:42.611852 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca728773-6b77-4a92-bc1d-5e93782a7b04 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:42.624013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 625/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:42.629812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d174f20-069b-4570-825d-69815fc0a095 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:42.730119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d174f20-069b-4570-825d-69815fc0a095 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.749454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.763118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0ae75-474a-4014-ad66-042c530e073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.763746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0ae75-474a-4014-ad66-042c530e073a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.764025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0ae75-474a-4014-ad66-042c530e073a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.764287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0ae75-474a-4014-ad66-042c530e073a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.771418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0ae75-474a-4014-ad66-042c530e073a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:42.772855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0ae75-474a-4014-ad66-042c530e073a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-12e0ae75-474a-4014-ad66-042c530e073a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:42.784376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:42.785528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:42.786743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 642/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:42.791937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca728773-6b77-4a92-bc1d-5e93782a7b04 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:42.891012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca728773-6b77-4a92-bc1d-5e93782a7b04 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.925195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f479a-a244-4f34-8f7b-6ea77ae51660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.925863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f479a-a244-4f34-8f7b-6ea77ae51660 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.926151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f479a-a244-4f34-8f7b-6ea77ae51660 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.926459 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f479a-a244-4f34-8f7b-6ea77ae51660 None admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.927186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f479a-a244-4f34-8f7b-6ea77ae51660 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:42.927494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f479a-a244-4f34-8f7b-6ea77ae51660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:42.928925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f479a-a244-4f34-8f7b-6ea77ae51660 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:42.937883 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.946693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 626/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:30:42.952421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0ae75-474a-4014-ad66-042c530e073a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:43.052519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0ae75-474a-4014-ad66-042c530e073a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:43.086183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31787a8-abf3-494d-8d3c-bd63a7e5858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:43.086833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31787a8-abf3-494d-8d3c-bd63a7e5858e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:43.087637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31787a8-abf3-494d-8d3c-bd63a7e5858e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:43.088060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31787a8-abf3-494d-8d3c-bd63a7e5858e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:43.098373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31787a8-abf3-494d-8d3c-bd63a7e5858e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:43.099808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31787a8-abf3-494d-8d3c-bd63a7e5858e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d31787a8-abf3-494d-8d3c-bd63a7e5858e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:43.114135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:43.115487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:43.116600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:43.116600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:43.116600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:43.116600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 643/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:43.121217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f479a-a244-4f34-8f7b-6ea77ae51660 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:43.222347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f479a-a244-4f34-8f7b-6ea77ae51660 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:43.257209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cede90f-8645-45e9-adc0-5b3c27724c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:43.257817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cede90f-8645-45e9-adc0-5b3c27724c83 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:43.258120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cede90f-8645-45e9-adc0-5b3c27724c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:43.258429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cede90f-8645-45e9-adc0-5b3c27724c83 None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:43.259610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cede90f-8645-45e9-adc0-5b3c27724c83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:43.259917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cede90f-8645-45e9-adc0-5b3c27724c83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:43.261281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cede90f-8645-45e9-adc0-5b3c27724c83 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:43.272494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 627/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:43.279099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31787a8-abf3-494d-8d3c-bd63a7e5858e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:43.309945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:43.376978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31787a8-abf3-494d-8d3c-bd63a7e5858e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:43.411257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daca5d7-b3b8-43b5-80fe-02577ffc5261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:43.411882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daca5d7-b3b8-43b5-80fe-02577ffc5261 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:43.412166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daca5d7-b3b8-43b5-80fe-02577ffc5261 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:43.412494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daca5d7-b3b8-43b5-80fe-02577ffc5261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:43.419306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daca5d7-b3b8-43b5-80fe-02577ffc5261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:43.420739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daca5d7-b3b8-43b5-80fe-02577ffc5261 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3daca5d7-b3b8-43b5-80fe-02577ffc5261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:43.431729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:43.432794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:43.433936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:43.433936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:43.433936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:43.433936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:43.433936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:43.433936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:43.433936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:43.433936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:43.433936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 644/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:43.438821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cede90f-8645-45e9-adc0-5b3c27724c83 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:43.497902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:43.538308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cede90f-8645-45e9-adc0-5b3c27724c83 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:43.570750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b87a3-5a9a-4420-9c14-a48fa8b40c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:43.571593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b87a3-5a9a-4420-9c14-a48fa8b40c4a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:43.573058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b87a3-5a9a-4420-9c14-a48fa8b40c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:43.573410 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b87a3-5a9a-4420-9c14-a48fa8b40c4a None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:43.574319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b87a3-5a9a-4420-9c14-a48fa8b40c4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:43.574754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b87a3-5a9a-4420-9c14-a48fa8b40c4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:43.576692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b87a3-5a9a-4420-9c14-a48fa8b40c4a None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:43.589195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 628/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:43.595403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daca5d7-b3b8-43b5-80fe-02577ffc5261 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:43.686311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:43.695090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daca5d7-b3b8-43b5-80fe-02577ffc5261 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:43.728285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a35592-ef79-4eb7-9dff-7db10150d3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:43.728727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35592-ef79-4eb7-9dff-7db10150d3d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:43.729010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35592-ef79-4eb7-9dff-7db10150d3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:43.729286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35592-ef79-4eb7-9dff-7db10150d3d7 None admin] PATH_INFO: `/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/6fa8495c97df48f18b10039584d52f8a/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:43.731228 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35592-ef79-4eb7-9dff-7db10150d3d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dcfbd4f4437418db2cacabef3850ffe, user_id=6fa8495c97df48f18b10039584d52f8a, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:43.732676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35592-ef79-4eb7-9dff-7db10150d3d7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:43.834939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 645/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 22 12:30:43 2022] PUT /identity/v3/projects/7dcfbd4f4437418db2cacabef3850ffe/users/6fa8495c97df48f18b10039584d52f8a/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:30:45.717956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9391ca-3edb-434f-b856-f26a8de4b08f None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:45.718524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9391ca-3edb-434f-b856-f26a8de4b08f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:45.718524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9391ca-3edb-434f-b856-f26a8de4b08f None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:45.719932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 629/1274] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:45.724977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c71aa4-c5b4-47d7-8046-3f515ec2e99f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:45.725405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c71aa4-c5b4-47d7-8046-3f515ec2e99f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:45.725510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c71aa4-c5b4-47d7-8046-3f515ec2e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:45.743959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e0c71aa4-c5b4-47d7-8046-3f515ec2e99f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:45.745474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e0c71aa4-c5b4-47d7-8046-3f515ec2e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:45.811211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 646/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:46.080631 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9391ca-3edb-434f-b856-f26a8de4b08f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:46.187028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9391ca-3edb-434f-b856-f26a8de4b08f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:46.204809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:46.221420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890134f7-13f7-49bf-98da-479690ef2c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:46.222040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890134f7-13f7-49bf-98da-479690ef2c6a None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:46.222352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890134f7-13f7-49bf-98da-479690ef2c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:46.222624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890134f7-13f7-49bf-98da-479690ef2c6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:46.233725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890134f7-13f7-49bf-98da-479690ef2c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-890134f7-13f7-49bf-98da-479690ef2c6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:46.238437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:46.244624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:46.245513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 630/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 22 12:30:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:46.246293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c71aa4-c5b4-47d7-8046-3f515ec2e99f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:46.326489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:46.344222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c71aa4-c5b4-47d7-8046-3f515ec2e99f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:46.376079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0174cc-a46d-4257-9831-a2480da80a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:46.380990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0174cc-a46d-4257-9831-a2480da80a55 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:46.380990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0174cc-a46d-4257-9831-a2480da80a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:46.380990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0174cc-a46d-4257-9831-a2480da80a55 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:46.380990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0174cc-a46d-4257-9831-a2480da80a55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:46.380990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0174cc-a46d-4257-9831-a2480da80a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:46.380990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0174cc-a46d-4257-9831-a2480da80a55 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:46.388081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 647/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 22 12:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:46.394058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890134f7-13f7-49bf-98da-479690ef2c6a None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:46.494963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890134f7-13f7-49bf-98da-479690ef2c6a None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:46.529612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9143fc-89be-43b0-ace3-d8c913bf26f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:46.530259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9143fc-89be-43b0-ace3-d8c913bf26f7 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:46.530546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9143fc-89be-43b0-ace3-d8c913bf26f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:46.530861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9143fc-89be-43b0-ace3-d8c913bf26f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:46.540865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9143fc-89be-43b0-ace3-d8c913bf26f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:46.542498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9143fc-89be-43b0-ace3-d8c913bf26f7 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-8c9143fc-89be-43b0-ace3-d8c913bf26f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:46.558024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:46.559192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:46.560203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:46.560203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:46.560203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:46.560203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 631/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:46.565209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0174cc-a46d-4257-9831-a2480da80a55 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:46.665441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0174cc-a46d-4257-9831-a2480da80a55 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:46.699992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14d09-c36c-4d18-be7b-0bb1b9551f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:46.700605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14d09-c36c-4d18-be7b-0bb1b9551f63 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:46.700893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14d09-c36c-4d18-be7b-0bb1b9551f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:46.701175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14d09-c36c-4d18-be7b-0bb1b9551f63 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:46.701820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c14d09-c36c-4d18-be7b-0bb1b9551f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:46.702133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c14d09-c36c-4d18-be7b-0bb1b9551f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:46.703539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c14d09-c36c-4d18-be7b-0bb1b9551f63 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:46.715014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 648/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:46.720672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9143fc-89be-43b0-ace3-d8c913bf26f7 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:46.751532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:46.819933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9143fc-89be-43b0-ace3-d8c913bf26f7 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:46.853814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d6e8-8e62-44a4-a9e0-39ee45b0ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:46.854487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d6e8-8e62-44a4-a9e0-39ee45b0ba59 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:46.854770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d6e8-8e62-44a4-a9e0-39ee45b0ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:46.855045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d6e8-8e62-44a4-a9e0-39ee45b0ba59 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:46.862551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4d6e8-8e62-44a4-a9e0-39ee45b0ba59 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:46.863983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4d6e8-8e62-44a4-a9e0-39ee45b0ba59 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-d9a4d6e8-8e62-44a4-a9e0-39ee45b0ba59 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:46.875407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:46.876580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:46.877753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 632/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:46.882471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14d09-c36c-4d18-be7b-0bb1b9551f63 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:46.886569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:46.982934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14d09-c36c-4d18-be7b-0bb1b9551f63 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:47.016563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f481a-da56-4138-a194-cd7bbb35a44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:47.017171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f481a-da56-4138-a194-cd7bbb35a44f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:47.017457 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f481a-da56-4138-a194-cd7bbb35a44f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:47.017734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f481a-da56-4138-a194-cd7bbb35a44f None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:47.018495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f481a-da56-4138-a194-cd7bbb35a44f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:47.018806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f481a-da56-4138-a194-cd7bbb35a44f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:47.020247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f481a-da56-4138-a194-cd7bbb35a44f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:47.036890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 649/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:47.043444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d6e8-8e62-44a4-a9e0-39ee45b0ba59 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:47.134670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:47.143905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d6e8-8e62-44a4-a9e0-39ee45b0ba59 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:47.176940 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bebf3c-3c9e-4a07-8d6d-092f2fa204ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:47.177552 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bebf3c-3c9e-4a07-8d6d-092f2fa204ad None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:47.177831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bebf3c-3c9e-4a07-8d6d-092f2fa204ad None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:47.178345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bebf3c-3c9e-4a07-8d6d-092f2fa204ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:47.247353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bebf3c-3c9e-4a07-8d6d-092f2fa204ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:47.248737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bebf3c-3c9e-4a07-8d6d-092f2fa204ad None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:47.337844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:47.347907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 633/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 22 12:30:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:30:47.354559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f481a-da56-4138-a194-cd7bbb35a44f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:47.442329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:47.486538 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f481a-da56-4138-a194-cd7bbb35a44f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:47.523970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1b4ed-c54e-4f01-a6fb-784d67ac6c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:47.524595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b4ed-c54e-4f01-a6fb-784d67ac6c57 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:47.525610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b4ed-c54e-4f01-a6fb-784d67ac6c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:47.525862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b4ed-c54e-4f01-a6fb-784d67ac6c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:47.536765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1b4ed-c54e-4f01-a6fb-784d67ac6c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:47.538280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1b4ed-c54e-4f01-a6fb-784d67ac6c57 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-1ee1b4ed-c54e-4f01-a6fb-784d67ac6c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:47.554092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:47.555218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:47.556245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:47.556245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:47.556245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:47.556245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 650/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:47.562284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bebf3c-3c9e-4a07-8d6d-092f2fa204ad None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:47.676484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bebf3c-3c9e-4a07-8d6d-092f2fa204ad None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:47.721884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1d1c3-3b80-4e03-87ac-5176d7501c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:47.722597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1d1c3-3b80-4e03-87ac-5176d7501c2f None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:47.722865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1d1c3-3b80-4e03-87ac-5176d7501c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:47.723139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1d1c3-3b80-4e03-87ac-5176d7501c2f None admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:47.723790 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1d1c3-3b80-4e03-87ac-5176d7501c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:47.724094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1d1c3-3b80-4e03-87ac-5176d7501c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:47.725460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1d1c3-3b80-4e03-87ac-5176d7501c2f None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:47.742235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 634/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:30:47.745952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1b4ed-c54e-4f01-a6fb-784d67ac6c57 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:47.849706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1b4ed-c54e-4f01-a6fb-784d67ac6c57 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:47.863784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:47.884496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a74b6-919d-4538-bfae-b9907a5c4480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:47.885210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a74b6-919d-4538-bfae-b9907a5c4480 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:47.885516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a74b6-919d-4538-bfae-b9907a5c4480 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:47.885793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a74b6-919d-4538-bfae-b9907a5c4480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:47.892469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a74b6-919d-4538-bfae-b9907a5c4480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:47.893930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a74b6-919d-4538-bfae-b9907a5c4480 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-116a74b6-919d-4538-bfae-b9907a5c4480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:47.904957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:47.912966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:47.914107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:47.914107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:47.914107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:47.914107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:47.914107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:47.914107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:47.914107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:47.914107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Aug 22 12:30:47.914107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 651/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:47.914750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1d1c3-3b80-4e03-87ac-5176d7501c2f None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:47.965518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:48.014053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1d1c3-3b80-4e03-87ac-5176d7501c2f None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:48.047124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4adaeb-28b4-4979-87fa-7ea1dbaf9380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:48.047723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4adaeb-28b4-4979-87fa-7ea1dbaf9380 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:48.048005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4adaeb-28b4-4979-87fa-7ea1dbaf9380 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:48.048280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4adaeb-28b4-4979-87fa-7ea1dbaf9380 None admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:48.048960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4adaeb-28b4-4979-87fa-7ea1dbaf9380 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:48.049266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4adaeb-28b4-4979-87fa-7ea1dbaf9380 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:48.050742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4adaeb-28b4-4979-87fa-7ea1dbaf9380 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:48.062362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 635/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:48.068890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a74b6-919d-4538-bfae-b9907a5c4480 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:48.170371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a74b6-919d-4538-bfae-b9907a5c4480 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:48.204530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6488c-725a-4924-8def-d3c33f055c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:48.205219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6488c-725a-4924-8def-d3c33f055c12 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:48.205480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6488c-725a-4924-8def-d3c33f055c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:48.205761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6488c-725a-4924-8def-d3c33f055c12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:48.206547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6488c-725a-4924-8def-d3c33f055c12 None admin] RBAC: Adding query filter params (role.id=38f75c8b41984e16bf66e035cfe922ee, scope.project.id=7dcfbd4f4437418db2cacabef3850ffe, user.id=6fa8495c97df48f18b10039584d52f8a) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:48.206863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6488c-725a-4924-8def-d3c33f055c12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:48.208306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6488c-725a-4924-8def-d3c33f055c12 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:48.214547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 652/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 22 12:30:48 2022] GET /identity/v3/role_assignments?user.id=6fa8495c97df48f18b10039584d52f8a&scope.project.id=7dcfbd4f4437418db2cacabef3850ffe&role.id=38f75c8b41984e16bf66e035cfe922ee => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:50.137964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5abf0f-1594-447f-a519-5c5e3ad4f6cb None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:50.138588 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5abf0f-1594-447f-a519-5c5e3ad4f6cb None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:50.138588 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5abf0f-1594-447f-a519-5c5e3ad4f6cb None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:50.139893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 636/1288] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:50.145158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bf7c8-a9e2-4ef9-8663-b7929139861a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:50.145612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bf7c8-a9e2-4ef9-8663-b7929139861a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:50.145720 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bf7c8-a9e2-4ef9-8663-b7929139861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:50.164411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-aa2bf7c8-a9e2-4ef9-8663-b7929139861a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:50.165656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aa2bf7c8-a9e2-4ef9-8663-b7929139861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:50.196119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:50.233646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 653/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:50.501744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5abf0f-1594-447f-a519-5c5e3ad4f6cb None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:50.604955 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5abf0f-1594-447f-a519-5c5e3ad4f6cb None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:50.615525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:50.638944 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196b2e-1ff5-4146-9667-673da455d6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:50.640666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196b2e-1ff5-4146-9667-673da455d6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:50.640666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196b2e-1ff5-4146-9667-673da455d6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:50.640666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196b2e-1ff5-4146-9667-673da455d6b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:50.640939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c196b2e-1ff5-4146-9667-673da455d6b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:50.642047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c196b2e-1ff5-4146-9667-673da455d6b8 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-0c196b2e-1ff5-4146-9667-673da455d6b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:50.651339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:50.652824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:50.653828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 637/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 22 12:30:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:50.660196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bf7c8-a9e2-4ef9-8663-b7929139861a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:50.761225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bf7c8-a9e2-4ef9-8663-b7929139861a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:50.794815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc428af2-cbf7-4f44-9a53-2ee70e096a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:50.795427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc428af2-cbf7-4f44-9a53-2ee70e096a41 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:50.795712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc428af2-cbf7-4f44-9a53-2ee70e096a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:50.795990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc428af2-cbf7-4f44-9a53-2ee70e096a41 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:50.796619 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc428af2-cbf7-4f44-9a53-2ee70e096a41 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:50.796931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc428af2-cbf7-4f44-9a53-2ee70e096a41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:50.798337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc428af2-cbf7-4f44-9a53-2ee70e096a41 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:50.804902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 654/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 22 12:30:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:50.811513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196b2e-1ff5-4146-9667-673da455d6b8 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:50.917160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196b2e-1ff5-4146-9667-673da455d6b8 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:50.950423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136b1d7-132b-4a60-b68f-c7413e556f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:50.951023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136b1d7-132b-4a60-b68f-c7413e556f80 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:50.951305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136b1d7-132b-4a60-b68f-c7413e556f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:50.951571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136b1d7-132b-4a60-b68f-c7413e556f80 None admin] PATH_INFO: `/v3/services` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:50.952184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136b1d7-132b-4a60-b68f-c7413e556f80 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:50.952481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136b1d7-132b-4a60-b68f-c7413e556f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:50.953825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136b1d7-132b-4a60-b68f-c7413e556f80 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:50.958071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 638/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 22 12:30:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:52.846950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137653-b8e8-4616-9d48-0cc52a835222 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:52.847482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137653-b8e8-4616-9d48-0cc52a835222 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:52.847482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137653-b8e8-4616-9d48-0cc52a835222 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:52.848854 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 655/1293] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:52.855173 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ef55c-adfa-4ac6-906e-7671a2a77577 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:52.855595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ef55c-adfa-4ac6-906e-7671a2a77577 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:52.855724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ef55c-adfa-4ac6-906e-7671a2a77577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:52.877464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-dd5ef55c-adfa-4ac6-906e-7671a2a77577 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:52.878789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-dd5ef55c-adfa-4ac6-906e-7671a2a77577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:52.908997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:52.951938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 639/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:53.223191 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da137653-b8e8-4616-9d48-0cc52a835222 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:53.260803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:53.334642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da137653-b8e8-4616-9d48-0cc52a835222 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:53.369097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debe3ed-f6ae-413e-8571-49f40e2453b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:53.369726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debe3ed-f6ae-413e-8571-49f40e2453b1 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:53.370005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debe3ed-f6ae-413e-8571-49f40e2453b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:53.370309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debe3ed-f6ae-413e-8571-49f40e2453b1 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:53.370947 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debe3ed-f6ae-413e-8571-49f40e2453b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:53.372410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debe3ed-f6ae-413e-8571-49f40e2453b1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:53.515473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 656/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 22 12:30:53 2022] POST /identity/v3/services => generated 246 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:30:55.417439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100731-3bd9-4039-868c-cba9addb7001 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:55.418034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100731-3bd9-4039-868c-cba9addb7001 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:55.418034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100731-3bd9-4039-868c-cba9addb7001 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:55.419649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 640/1296] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:55.425716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883dca6-1cdb-4498-9294-672442f7e63d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:55.426314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883dca6-1cdb-4498-9294-672442f7e63d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:55.426314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883dca6-1cdb-4498-9294-672442f7e63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:55.446802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7883dca6-1cdb-4498-9294-672442f7e63d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:55.448706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7883dca6-1cdb-4498-9294-672442f7e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:55.537321 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 657/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:55.805407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85100731-3bd9-4039-868c-cba9addb7001 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:55.911780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85100731-3bd9-4039-868c-cba9addb7001 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:55.945553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924f6f0-da44-4540-a715-07218783fc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:55.946168 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924f6f0-da44-4540-a715-07218783fc5d None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:55.946480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924f6f0-da44-4540-a715-07218783fc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:55.947844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924f6f0-da44-4540-a715-07218783fc5d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:55.948426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924f6f0-da44-4540-a715-07218783fc5d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:55.949938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924f6f0-da44-4540-a715-07218783fc5d None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-d924f6f0-da44-4540-a715-07218783fc5d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:55.958544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:55.959755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:55.960618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 641/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 22 12:30:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:55.966325 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883dca6-1cdb-4498-9294-672442f7e63d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:55.984443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:56.063012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883dca6-1cdb-4498-9294-672442f7e63d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:56.098239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6bb14-d785-4e77-ba34-741f420ba7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:56.098949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6bb14-d785-4e77-ba34-741f420ba7ca None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:56.099304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6bb14-d785-4e77-ba34-741f420ba7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:56.099583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6bb14-d785-4e77-ba34-741f420ba7ca None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:56.100268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6bb14-d785-4e77-ba34-741f420ba7ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:56.100574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6bb14-d785-4e77-ba34-741f420ba7ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:56.102003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6bb14-d785-4e77-ba34-741f420ba7ca None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:56.107155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 658/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 22 12:30:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:56.113281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924f6f0-da44-4540-a715-07218783fc5d None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:56.145933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:56.214984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924f6f0-da44-4540-a715-07218783fc5d None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:56.248048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6b35-1129-46b0-b6c4-46f9c6748f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:56.248651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6b35-1129-46b0-b6c4-46f9c6748f55 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:56.248933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6b35-1129-46b0-b6c4-46f9c6748f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:56.249207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6b35-1129-46b0-b6c4-46f9c6748f55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:56.249899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6b35-1129-46b0-b6c4-46f9c6748f55 None admin] RBAC: Adding query filter params (interface=public, service_id=2137caae6e204608b1ef5c481f915b7d, region_id=RegionOne) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:56.250231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6b35-1129-46b0-b6c4-46f9c6748f55 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:56.251585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6b35-1129-46b0-b6c4-46f9c6748f55 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:56.256595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 642/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 22 12:30:56 2022] GET /identity/v3/endpoints?service_id=2137caae6e204608b1ef5c481f915b7d&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:56.262772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6bb14-d785-4e77-ba34-741f420ba7ca None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:56.345070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:56.362312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6bb14-d785-4e77-ba34-741f420ba7ca None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:56.396045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda52df5-dd63-45ca-823f-66edabdc21ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:56.396651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda52df5-dd63-45ca-823f-66edabdc21ab None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:56.396938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda52df5-dd63-45ca-823f-66edabdc21ab None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:56.397214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda52df5-dd63-45ca-823f-66edabdc21ab None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:56.397813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda52df5-dd63-45ca-823f-66edabdc21ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:56.399215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda52df5-dd63-45ca-823f-66edabdc21ab None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:56.405944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 659/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 22 12:30:56 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:30:58.368584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89543fc8-a708-483f-bdfe-20987dea824b None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:58.369351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89543fc8-a708-483f-bdfe-20987dea824b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:58.369351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89543fc8-a708-483f-bdfe-20987dea824b None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:58.370675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 643/1302] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:58.375977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756eb0-118c-4cea-9e49-4b7955b6d70e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:58.376396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756eb0-118c-4cea-9e49-4b7955b6d70e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:58.376539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756eb0-118c-4cea-9e49-4b7955b6d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:58.394911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-61756eb0-118c-4cea-9e49-4b7955b6d70e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:58.396088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-61756eb0-118c-4cea-9e49-4b7955b6d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:58.464112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 660/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:58.729282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89543fc8-a708-483f-bdfe-20987dea824b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:58.829575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:58.836674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89543fc8-a708-483f-bdfe-20987dea824b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:58.872026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55e84-e0f1-4f5c-a627-410504351cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:58.872666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55e84-e0f1-4f5c-a627-410504351cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:58.872950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55e84-e0f1-4f5c-a627-410504351cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:58.873226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55e84-e0f1-4f5c-a627-410504351cc6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:58.873920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf55e84-e0f1-4f5c-a627-410504351cc6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:58.875393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf55e84-e0f1-4f5c-a627-410504351cc6 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application [None req-acf55e84-e0f1-4f5c-a627-410504351cc6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:58.885163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:58.887394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: ERROR keystone.server.flask.application Aug 22 12:30:58.888504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 644/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 22 12:30:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:30:58.892454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61756eb0-118c-4cea-9e49-4b7955b6d70e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:58.967823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:58.992171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61756eb0-118c-4cea-9e49-4b7955b6d70e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:59.027243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2a08e-88a1-4086-8e4e-fc9ea2cb7d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:59.027923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2a08e-88a1-4086-8e4e-fc9ea2cb7d29 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:59.028280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2a08e-88a1-4086-8e4e-fc9ea2cb7d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:59.028619 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2a08e-88a1-4086-8e4e-fc9ea2cb7d29 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:59.029316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2a08e-88a1-4086-8e4e-fc9ea2cb7d29 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:59.029798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2a08e-88a1-4086-8e4e-fc9ea2cb7d29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:59.031531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2a08e-88a1-4086-8e4e-fc9ea2cb7d29 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:59.036873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 661/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 22 12:30:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:59.043402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55e84-e0f1-4f5c-a627-410504351cc6 None admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:59.147491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55e84-e0f1-4f5c-a627-410504351cc6 None admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:59.183061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb02568-d283-4465-99ae-131b9a90f803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:59.183673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb02568-d283-4465-99ae-131b9a90f803 None admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:59.183953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb02568-d283-4465-99ae-131b9a90f803 None admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:59.184223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb02568-d283-4465-99ae-131b9a90f803 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:59.184868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb02568-d283-4465-99ae-131b9a90f803 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:59.186257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb02568-d283-4465-99ae-131b9a90f803 None admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:59.286415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 645/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:30:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:31:09.034147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=30 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:31:09.281901 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:36.013935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d627cd-63d3-4b91-a272-666b5e3f69d9 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:36.015053 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d627cd-63d3-4b91-a272-666b5e3f69d9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:36.015552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d627cd-63d3-4b91-a272-666b5e3f69d9 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:36.022565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3d8f-e298-4567-8309-9088b1cf07c7 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:36.023435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3d8f-e298-4567-8309-9088b1cf07c7 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:36.023941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3d8f-e298-4567-8309-9088b1cf07c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:36.028651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 662/1307] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:38:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:36.167728 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-794a3d8f-e298-4567-8309-9088b1cf07c7 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:36.181762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-794a3d8f-e298-4567-8309-9088b1cf07c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:36.386250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 646/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:36.679811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df346fe-b973-4bd0-90f3-0a400a525d12 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:36.680188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df346fe-b973-4bd0-90f3-0a400a525d12 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:36.680539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df346fe-b973-4bd0-90f3-0a400a525d12 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:36.682031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 663/1309] 10.222.0.23 () {54 vars in 965 bytes} [Mon Aug 22 12:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:36.688130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aecbe-b31f-4138-9680-af7ef14fa564 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:36.688491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aecbe-b31f-4138-9680-af7ef14fa564 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:36.688859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aecbe-b31f-4138-9680-af7ef14fa564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:36.767558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-8b6aecbe-b31f-4138-9680-af7ef14fa564 None None] MFA Rules not processed for user `948a5df1d4244c839a7faeb54f93dfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:36.768786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8b6aecbe-b31f-4138-9680-af7ef14fa564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:36.790730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:36.849007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 647/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Aug 22 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:36.858066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df346fe-b973-4bd0-90f3-0a400a525d12 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:36.859907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1df346fe-b973-4bd0-90f3-0a400a525d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:36.993563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df346fe-b973-4bd0-90f3-0a400a525d12 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:37.077525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f1cd4-3fa0-4012-9462-9c07413eac8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:37.078277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f1cd4-3fa0-4012-9462-9c07413eac8b service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:37.078475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f1cd4-3fa0-4012-9462-9c07413eac8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:37.078818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f1cd4-3fa0-4012-9462-9c07413eac8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:37.080352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-893f1cd4-3fa0-4012-9462-9c07413eac8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:37.141668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:37.203925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f1cd4-3fa0-4012-9462-9c07413eac8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:37.205382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f1cd4-3fa0-4012-9462-9c07413eac8b service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:37.225697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 664/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:39.486946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae199-d72a-4ad9-b8f8-5d9accb4b3ee None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:39.487559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae199-d72a-4ad9-b8f8-5d9accb4b3ee None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:39.487559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae199-d72a-4ad9-b8f8-5d9accb4b3ee None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:39.488948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 648/1312] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:39.494681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d30eb-917d-4cd8-a9c2-e66a6bb54a53 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:39.495167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d30eb-917d-4cd8-a9c2-e66a6bb54a53 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:39.495283 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d30eb-917d-4cd8-a9c2-e66a6bb54a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:39.578729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f10d30eb-917d-4cd8-a9c2-e66a6bb54a53 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:39.580080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f10d30eb-917d-4cd8-a9c2-e66a6bb54a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:39.693623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 665/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:39.985823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae199-d72a-4ad9-b8f8-5d9accb4b3ee None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:39.987447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-95bae199-d72a-4ad9-b8f8-5d9accb4b3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:40.091346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae199-d72a-4ad9-b8f8-5d9accb4b3ee None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:40.160013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:40.162525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d826c-e370-4a81-8274-872601884cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:40.163122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d826c-e370-4a81-8274-872601884cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:40.163401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d826c-e370-4a81-8274-872601884cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:40.163671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d826c-e370-4a81-8274-872601884cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:40.165245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-fd0d826c-e370-4a81-8274-872601884cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:40.272647 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d826c-e370-4a81-8274-872601884cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:40.274063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d826c-e370-4a81-8274-872601884cb1 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:40.291507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 649/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:42.684121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c71d5-8b4a-4a38-9f40-e8b4bc518fd3 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:42.684687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c71d5-8b4a-4a38-9f40-e8b4bc518fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:42.684797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c71d5-8b4a-4a38-9f40-e8b4bc518fd3 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:42.686118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 666/1315] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:42.692064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38ad6e-dfd3-4d21-8947-455d20c8b1c4 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:42.692510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38ad6e-dfd3-4d21-8947-455d20c8b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:42.692619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38ad6e-dfd3-4d21-8947-455d20c8b1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:42.759313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-cb38ad6e-dfd3-4d21-8947-455d20c8b1c4 None None] MFA Rules not processed for user `ecc7c7fa70a7464e9cd9aa6f926b633e`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:42.760512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cb38ad6e-dfd3-4d21-8947-455d20c8b1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:42.810948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:42.855010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 650/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:43.156628 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c71d5-8b4a-4a38-9f40-e8b4bc518fd3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:43.158303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a13c71d5-8b4a-4a38-9f40-e8b4bc518fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:43.168827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:43.267753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c71d5-8b4a-4a38-9f40-e8b4bc518fd3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:43.340297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f3ac2-21ae-4707-9e9c-e6b37e98067c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:43.340899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f3ac2-21ae-4707-9e9c-e6b37e98067c service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:43.341184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f3ac2-21ae-4707-9e9c-e6b37e98067c service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:43.341479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f3ac2-21ae-4707-9e9c-e6b37e98067c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:43.343099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8d4f3ac2-21ae-4707-9e9c-e6b37e98067c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:43.404644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:43.451961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f3ac2-21ae-4707-9e9c-e6b37e98067c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:43.453677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f3ac2-21ae-4707-9e9c-e6b37e98067c service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:43.471894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 667/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:46.296876 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53579a-e325-47fa-b42e-b13ba456afbb None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:46.297428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53579a-e325-47fa-b42e-b13ba456afbb None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:46.297428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53579a-e325-47fa-b42e-b13ba456afbb None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:46.298807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 651/1318] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:46.304961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344fdfc-f95d-4356-80ac-1c25c104ac25 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:46.305383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344fdfc-f95d-4356-80ac-1c25c104ac25 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:46.305519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344fdfc-f95d-4356-80ac-1c25c104ac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:46.371367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e344fdfc-f95d-4356-80ac-1c25c104ac25 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:46.372601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e344fdfc-f95d-4356-80ac-1c25c104ac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:46.468472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 668/1319] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:46.756155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53579a-e325-47fa-b42e-b13ba456afbb None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:46.757698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6b53579a-e325-47fa-b42e-b13ba456afbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:46.859324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53579a-e325-47fa-b42e-b13ba456afbb None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:46.931630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dda30-8664-409c-b239-19ab3352e5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:46.932226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dda30-8664-409c-b239-19ab3352e5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:46.932500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dda30-8664-409c-b239-19ab3352e5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:46.932770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dda30-8664-409c-b239-19ab3352e5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:46.934347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-eb7dda30-8664-409c-b239-19ab3352e5d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:46.941159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:47.042880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dda30-8664-409c-b239-19ab3352e5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:47.044238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dda30-8664-409c-b239-19ab3352e5d4 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:47.062074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 652/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:50.001020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da3e3a-c3f8-45e8-8389-24c14ac5b381 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:50.001568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da3e3a-c3f8-45e8-8389-24c14ac5b381 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:50.001568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da3e3a-c3f8-45e8-8389-24c14ac5b381 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:50.003228 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 669/1321] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:38:50.008577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539143-78fe-49dc-bd66-01dc2f5c8708 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:50.009015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539143-78fe-49dc-bd66-01dc2f5c8708 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:50.009222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539143-78fe-49dc-bd66-01dc2f5c8708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:50.082231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-19539143-78fe-49dc-bd66-01dc2f5c8708 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:50.083743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-19539143-78fe-49dc-bd66-01dc2f5c8708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:50.146582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:50.185564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 653/1322] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:50.478400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da3e3a-c3f8-45e8-8389-24c14ac5b381 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:50.479991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-68da3e3a-c3f8-45e8-8389-24c14ac5b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:50.500691 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:50.590697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da3e3a-c3f8-45e8-8389-24c14ac5b381 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:50.667244 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7f922-6a21-4307-bd0a-4352645fb4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:50.667862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7f922-6a21-4307-bd0a-4352645fb4dc service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:50.668153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7f922-6a21-4307-bd0a-4352645fb4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:50.668428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7f922-6a21-4307-bd0a-4352645fb4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:50.670091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-33d7f922-6a21-4307-bd0a-4352645fb4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:50.743139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:50.781151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7f922-6a21-4307-bd0a-4352645fb4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:50.782656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7f922-6a21-4307-bd0a-4352645fb4dc service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:50.801519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 670/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:52.792298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9c917-9f3d-49f6-b6f5-bffc04c0dc9a None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:52.792827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9c917-9f3d-49f6-b6f5-bffc04c0dc9a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:52.792924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9c917-9f3d-49f6-b6f5-bffc04c0dc9a None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:52.794374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 654/1324] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:52.800580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46f2fd-da2c-43b4-b0ba-b4c1101ff473 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:52.801045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46f2fd-da2c-43b4-b0ba-b4c1101ff473 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:52.801143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46f2fd-da2c-43b4-b0ba-b4c1101ff473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:52.867512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3c46f2fd-da2c-43b4-b0ba-b4c1101ff473 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:52.868741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3c46f2fd-da2c-43b4-b0ba-b4c1101ff473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:52.964739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 671/1325] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:53.266397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eae82-f70c-4f6b-ae30-3d32b9b39d5f None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:53.266686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eae82-f70c-4f6b-ae30-3d32b9b39d5f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:53.266965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eae82-f70c-4f6b-ae30-3d32b9b39d5f None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:53.268484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 655/1326] 10.222.0.23 () {54 vars in 965 bytes} [Mon Aug 22 12:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:53.274984 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5938a3f-288d-48aa-93b1-cc8e58d66275 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:53.275278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5938a3f-288d-48aa-93b1-cc8e58d66275 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:53.275567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5938a3f-288d-48aa-93b1-cc8e58d66275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:53.308193 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:53.353461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d5938a3f-288d-48aa-93b1-cc8e58d66275 None None] MFA Rules not processed for user `948a5df1d4244c839a7faeb54f93dfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:53.355302 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d5938a3f-288d-48aa-93b1-cc8e58d66275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:53.437454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 672/1327] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Aug 22 12:38:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:53.446786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0eae82-f70c-4f6b-ae30-3d32b9b39d5f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:53.448400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-fe0eae82-f70c-4f6b-ae30-3d32b9b39d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:53.553841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0eae82-f70c-4f6b-ae30-3d32b9b39d5f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:53.627474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252c2ac-ca97-4d15-9d61-9d6d20a7d6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:53.628099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252c2ac-ca97-4d15-9d61-9d6d20a7d6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:53.628380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252c2ac-ca97-4d15-9d61-9d6d20a7d6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:53.628653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252c2ac-ca97-4d15-9d61-9d6d20a7d6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:53.630274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9252c2ac-ca97-4d15-9d61-9d6d20a7d6c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:53.647722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:53.743145 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252c2ac-ca97-4d15-9d61-9d6d20a7d6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:53.744511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252c2ac-ca97-4d15-9d61-9d6d20a7d6c5 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:53.762619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 656/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:55.992213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd21c97-f751-4234-8aec-764814abdf40 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:55.992213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd21c97-f751-4234-8aec-764814abdf40 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:55.992213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd21c97-f751-4234-8aec-764814abdf40 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:55.993051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 673/1329] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:56.004069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36edda-f7b5-4768-af89-3f2c214940a5 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:56.004955 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36edda-f7b5-4768-af89-3f2c214940a5 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:56.005462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36edda-f7b5-4768-af89-3f2c214940a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:56.079092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-3b36edda-f7b5-4768-af89-3f2c214940a5 None None] MFA Rules not processed for user `ecc7c7fa70a7464e9cd9aa6f926b633e`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:56.080251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3b36edda-f7b5-4768-af89-3f2c214940a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:56.149892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:56.181952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 657/1330] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:56.467199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd21c97-f751-4234-8aec-764814abdf40 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:56.468813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ddd21c97-f751-4234-8aec-764814abdf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:56.573308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd21c97-f751-4234-8aec-764814abdf40 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:56.593645 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:56.653378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259f338-9c96-4af2-bdca-8c57146b92da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:56.654007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259f338-9c96-4af2-bdca-8c57146b92da service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:56.654322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259f338-9c96-4af2-bdca-8c57146b92da service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:56.654604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259f338-9c96-4af2-bdca-8c57146b92da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:56.656218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3259f338-9c96-4af2-bdca-8c57146b92da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:56.771454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259f338-9c96-4af2-bdca-8c57146b92da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:56.772917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259f338-9c96-4af2-bdca-8c57146b92da service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:56.792046 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 674/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:59.363892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdde508-2a38-4a57-81be-62c87b687d1a None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:59.364451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdde508-2a38-4a57-81be-62c87b687d1a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:59.364451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdde508-2a38-4a57-81be-62c87b687d1a None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:59.365812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 658/1332] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:59.371178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b25b50-533f-4fdb-9d0c-6061b946a16d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:59.371609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b25b50-533f-4fdb-9d0c-6061b946a16d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:59.371738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b25b50-533f-4fdb-9d0c-6061b946a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:59.436741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:59.439276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a4b25b50-533f-4fdb-9d0c-6061b946a16d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:59.440613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a4b25b50-533f-4fdb-9d0c-6061b946a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:59.535957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 675/1333] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:59.815851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdde508-2a38-4a57-81be-62c87b687d1a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:59.817393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1bdde508-2a38-4a57-81be-62c87b687d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:59.920611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdde508-2a38-4a57-81be-62c87b687d1a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:59.992354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f415e-8536-457d-a1c5-625e35fcc61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:59.992965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f415e-8536-457d-a1c5-625e35fcc61c service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:59.993249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f415e-8536-457d-a1c5-625e35fcc61c service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:59.993527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f415e-8536-457d-a1c5-625e35fcc61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:59.995173 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-113f415e-8536-457d-a1c5-625e35fcc61c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:00.022833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:00.105542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f415e-8536-457d-a1c5-625e35fcc61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:00.106917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f415e-8536-457d-a1c5-625e35fcc61c service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:00.126558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 659/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:02.093699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee06e-d96e-4a25-a400-b4b4ce2316eb None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:02.094335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee06e-d96e-4a25-a400-b4b4ce2316eb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:02.094335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee06e-d96e-4a25-a400-b4b4ce2316eb None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:02.095633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 676/1335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:02.101795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdac52-2f17-4503-b96e-b66e5392fa2a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:02.104260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdac52-2f17-4503-b96e-b66e5392fa2a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:02.104260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdac52-2f17-4503-b96e-b66e5392fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:02.167488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-82bdac52-2f17-4503-b96e-b66e5392fa2a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:02.168624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-82bdac52-2f17-4503-b96e-b66e5392fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:02.244069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:02.266107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 660/1336] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:02.557357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee06e-d96e-4a25-a400-b4b4ce2316eb None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:02.559063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-00eee06e-d96e-4a25-a400-b4b4ce2316eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:02.662113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee06e-d96e-4a25-a400-b4b4ce2316eb None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:02.690885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:02.737315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2529c7-c85d-45a9-b90f-208e0bae175c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:02.738086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2529c7-c85d-45a9-b90f-208e0bae175c service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:02.738399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2529c7-c85d-45a9-b90f-208e0bae175c service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:02.738675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2529c7-c85d-45a9-b90f-208e0bae175c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:02.740306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1d2529c7-c85d-45a9-b90f-208e0bae175c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:02.849943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2529c7-c85d-45a9-b90f-208e0bae175c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:02.851350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2529c7-c85d-45a9-b90f-208e0bae175c service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:02.870153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 677/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:05.517368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25e9b9-26bb-47b5-a7e3-01161f5d69a3 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:05.519171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25e9b9-26bb-47b5-a7e3-01161f5d69a3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:05.519171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25e9b9-26bb-47b5-a7e3-01161f5d69a3 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:05.519805 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 661/1338] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:05.525033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f3782-a81e-419c-b113-f3b4aaa1be86 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:05.525465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f3782-a81e-419c-b113-f3b4aaa1be86 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:05.525613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f3782-a81e-419c-b113-f3b4aaa1be86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:05.593340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-669f3782-a81e-419c-b113-f3b4aaa1be86 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:05.595026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-669f3782-a81e-419c-b113-f3b4aaa1be86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:05.604251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:05.692834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 678/1339] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:05.979406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25e9b9-26bb-47b5-a7e3-01161f5d69a3 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:05.980976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6a25e9b9-26bb-47b5-a7e3-01161f5d69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:06.085664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25e9b9-26bb-47b5-a7e3-01161f5d69a3 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:06.160127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8271806-a299-401e-8a7f-0ba2fdf74c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:06.160651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8271806-a299-401e-8a7f-0ba2fdf74c91 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:06.160935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8271806-a299-401e-8a7f-0ba2fdf74c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:06.161210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8271806-a299-401e-8a7f-0ba2fdf74c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:06.162936 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f8271806-a299-401e-8a7f-0ba2fdf74c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:06.199110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:06.272974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8271806-a299-401e-8a7f-0ba2fdf74c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:06.274449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8271806-a299-401e-8a7f-0ba2fdf74c91 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:06.292788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 662/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:10.554292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ad30-bba1-4c92-8786-9bedac70257c None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:10.554824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ad30-bba1-4c92-8786-9bedac70257c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:10.555023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ad30-bba1-4c92-8786-9bedac70257c None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:10.556395 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 679/1341] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:10.561978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81ef96-f5ca-4cdd-8255-e20f4e64a112 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:10.562423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81ef96-f5ca-4cdd-8255-e20f4e64a112 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:10.562544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81ef96-f5ca-4cdd-8255-e20f4e64a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:10.632837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5f81ef96-f5ca-4cdd-8255-e20f4e64a112 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:10.634800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5f81ef96-f5ca-4cdd-8255-e20f4e64a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:10.722979 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:10.734234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 663/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:11.016967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ad30-bba1-4c92-8786-9bedac70257c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:11.018701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d5d0ad30-bba1-4c92-8786-9bedac70257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:11.125742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ad30-bba1-4c92-8786-9bedac70257c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:11.165579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:11.203897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a4d96-abab-4f7b-aae0-c242c292307f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:11.204556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a4d96-abab-4f7b-aae0-c242c292307f service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:11.205135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a4d96-abab-4f7b-aae0-c242c292307f service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:11.205641 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a4d96-abab-4f7b-aae0-c242c292307f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:11.207741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-660a4d96-abab-4f7b-aae0-c242c292307f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:11.322742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a4d96-abab-4f7b-aae0-c242c292307f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:11.324210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a4d96-abab-4f7b-aae0-c242c292307f service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:11.342566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 680/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:14.161986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c97a2-1342-4e81-86b7-680b53af4ec0 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:14.162547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c97a2-1342-4e81-86b7-680b53af4ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:14.162547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c97a2-1342-4e81-86b7-680b53af4ec0 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:14.163898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 664/1344] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:14.169285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d944d1-1009-4d8a-aaa1-15a1f4053edf None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:14.169706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d944d1-1009-4d8a-aaa1-15a1f4053edf None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:14.169875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d944d1-1009-4d8a-aaa1-15a1f4053edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:14.238350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-89d944d1-1009-4d8a-aaa1-15a1f4053edf None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:14.239523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-89d944d1-1009-4d8a-aaa1-15a1f4053edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:14.257571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:14.339348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 681/1345] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:14.630512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c97a2-1342-4e81-86b7-680b53af4ec0 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:14.632171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-459c97a2-1342-4e81-86b7-680b53af4ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:14.740790 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c97a2-1342-4e81-86b7-680b53af4ec0 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:14.815212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7d5f4-0f17-4b2f-82c8-79c0d4524208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:14.815842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7d5f4-0f17-4b2f-82c8-79c0d4524208 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:14.816129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7d5f4-0f17-4b2f-82c8-79c0d4524208 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:14.816406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7d5f4-0f17-4b2f-82c8-79c0d4524208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:14.818021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-05b7d5f4-0f17-4b2f-82c8-79c0d4524208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:14.864199 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:14.934736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7d5f4-0f17-4b2f-82c8-79c0d4524208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:14.936162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7d5f4-0f17-4b2f-82c8-79c0d4524208 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:14.956626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 665/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:19.318633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0c66c-f3ca-46d0-b0aa-c7bf89219768 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:19.319137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0c66c-f3ca-46d0-b0aa-c7bf89219768 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:19.319260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0c66c-f3ca-46d0-b0aa-c7bf89219768 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:19.320567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 682/1347] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:19.326383 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490651-ef8a-4db1-af77-501400a4b51b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:19.326804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490651-ef8a-4db1-af77-501400a4b51b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:19.326915 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490651-ef8a-4db1-af77-501400a4b51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:19.401892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e1490651-ef8a-4db1-af77-501400a4b51b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:19.403204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e1490651-ef8a-4db1-af77-501400a4b51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:19.504030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:19.508886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 666/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:19.789608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0c66c-f3ca-46d0-b0aa-c7bf89219768 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:19.791139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-14b0c66c-f3ca-46d0-b0aa-c7bf89219768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:19.896821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0c66c-f3ca-46d0-b0aa-c7bf89219768 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:19.949543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:19.976450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46473155-91eb-4e3d-b229-9f4691dab0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:19.977065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46473155-91eb-4e3d-b229-9f4691dab0ba service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:19.977375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46473155-91eb-4e3d-b229-9f4691dab0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:19.977652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46473155-91eb-4e3d-b229-9f4691dab0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:19.979327 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-46473155-91eb-4e3d-b229-9f4691dab0ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:20.093026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46473155-91eb-4e3d-b229-9f4691dab0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:20.094586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46473155-91eb-4e3d-b229-9f4691dab0ba service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:20.115057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 683/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:25.014764 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228285-0e80-4d3c-a599-b6241b51cfae None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:25.015212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228285-0e80-4d3c-a599-b6241b51cfae None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:25.015501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228285-0e80-4d3c-a599-b6241b51cfae None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:25.017587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 667/1350] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:25.022827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7725b-c834-477c-a860-1afbdebea6e6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:25.023665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7725b-c834-477c-a860-1afbdebea6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:25.024175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7725b-c834-477c-a860-1afbdebea6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:25.115802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4ab7725b-c834-477c-a860-1afbdebea6e6 None None] MFA Rules not processed for user `6fa8495c97df48f18b10039584d52f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:25.117198 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4ab7725b-c834-477c-a860-1afbdebea6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:25.170276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:25.313467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 684/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:29.330226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075630-399e-4e22-ad29-85091294a5dc None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:29.330774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075630-399e-4e22-ad29-85091294a5dc None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:29.330858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075630-399e-4e22-ad29-85091294a5dc None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:29.332429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 668/1352] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:29.337315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e13ac5-5ad6-446f-91a2-f5893ee525ce None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:29.337767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e13ac5-5ad6-446f-91a2-f5893ee525ce None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:29.338071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e13ac5-5ad6-446f-91a2-f5893ee525ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:29.415475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c1e13ac5-5ad6-446f-91a2-f5893ee525ce None None] MFA Rules not processed for user `6fa8495c97df48f18b10039584d52f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:29.416836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c1e13ac5-5ad6-446f-91a2-f5893ee525ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:29.492674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:29.531383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 685/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:31.170048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8958d3-8c4c-45b1-b801-fcfe7aad512e None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:31.170597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8958d3-8c4c-45b1-b801-fcfe7aad512e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:31.170717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8958d3-8c4c-45b1-b801-fcfe7aad512e None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:31.172144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 669/1354] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:31.180069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334afd71-a263-4620-8a28-76901af4b9c5 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:31.180499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334afd71-a263-4620-8a28-76901af4b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:31.180849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334afd71-a263-4620-8a28-76901af4b9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:31.261091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-334afd71-a263-4620-8a28-76901af4b9c5 None None] MFA Rules not processed for user `6fa8495c97df48f18b10039584d52f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:31.262336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-334afd71-a263-4620-8a28-76901af4b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:31.382134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 686/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:34.657879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b930aba-f00f-410f-98bd-9e557b4ecaee None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:34.658692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b930aba-f00f-410f-98bd-9e557b4ecaee None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:34.658692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b930aba-f00f-410f-98bd-9e557b4ecaee None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:34.660055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 670/1356] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:34.665475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b139e-317d-4758-92a7-307e4d370928 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:34.665915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b139e-317d-4758-92a7-307e4d370928 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:34.666039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b139e-317d-4758-92a7-307e4d370928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:34.715410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:34.747075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-257b139e-317d-4758-92a7-307e4d370928 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:34.748359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-257b139e-317d-4758-92a7-307e4d370928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:34.877302 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 687/1357] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:35.184879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12b6dd-5cc2-47a5-b7ad-8cc374c4ec3f None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:35.185376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12b6dd-5cc2-47a5-b7ad-8cc374c4ec3f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:35.185807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12b6dd-5cc2-47a5-b7ad-8cc374c4ec3f None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:35.187317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 671/1358] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 22 12:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:35.196926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3276992-53c7-4277-a561-98fed796d103 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:35.197468 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3276992-53c7-4277-a561-98fed796d103 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:35.198083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3276992-53c7-4277-a561-98fed796d103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:35.301272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e3276992-53c7-4277-a561-98fed796d103 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:35.302702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e3276992-53c7-4277-a561-98fed796d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:35.361363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:35.434022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 688/1359] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 22 12:39:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:35.442343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12b6dd-5cc2-47a5-b7ad-8cc374c4ec3f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:35.443969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3b12b6dd-5cc2-47a5-b7ad-8cc374c4ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:35.623160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12b6dd-5cc2-47a5-b7ad-8cc374c4ec3f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:35.706219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:35.750082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210ddc9-d056-4838-a4e7-67329d2ed802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:35.750763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ddc9-d056-4838-a4e7-67329d2ed802 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:35.751100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ddc9-d056-4838-a4e7-67329d2ed802 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:35.751355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ddc9-d056-4838-a4e7-67329d2ed802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:35.752971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b210ddc9-d056-4838-a4e7-67329d2ed802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:35.848305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210ddc9-d056-4838-a4e7-67329d2ed802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:35.849821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210ddc9-d056-4838-a4e7-67329d2ed802 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:35.869325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 672/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:38.025875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4bb28-2909-4c2b-acda-e4b3932322c1 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:38.026555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4bb28-2909-4c2b-acda-e4b3932322c1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:38.026555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4bb28-2909-4c2b-acda-e4b3932322c1 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:38.027977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 689/1361] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:38.034308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50087e01-964a-4f26-9793-3f2b52088360 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:38.035095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50087e01-964a-4f26-9793-3f2b52088360 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:38.035667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50087e01-964a-4f26-9793-3f2b52088360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:38.109800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-50087e01-964a-4f26-9793-3f2b52088360 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:38.111187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-50087e01-964a-4f26-9793-3f2b52088360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:38.152788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:38.230240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 673/1362] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:38.530385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4bb28-2909-4c2b-acda-e4b3932322c1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:38.530385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-73b4bb28-2909-4c2b-acda-e4b3932322c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:38.711321 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4bb28-2909-4c2b-acda-e4b3932322c1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:38.722389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:38.832340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d348c-8db4-41e0-9c99-8900d3fa8d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:38.832963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d348c-8db4-41e0-9c99-8900d3fa8d41 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:38.833252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d348c-8db4-41e0-9c99-8900d3fa8d41 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:38.833532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d348c-8db4-41e0-9c99-8900d3fa8d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:38.835188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-942d348c-8db4-41e0-9c99-8900d3fa8d41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:38.933900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d348c-8db4-41e0-9c99-8900d3fa8d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:38.935914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d348c-8db4-41e0-9c99-8900d3fa8d41 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:38.956284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 690/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:41.338182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3f365-2b67-4db9-8de7-c64366267fa5 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:41.338763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3f365-2b67-4db9-8de7-c64366267fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:41.338763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3f365-2b67-4db9-8de7-c64366267fa5 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:41.340094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 674/1364] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:41.346383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa19840-432e-42cb-bfae-e0abdb2d215d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:41.346865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa19840-432e-42cb-bfae-e0abdb2d215d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:41.346951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa19840-432e-42cb-bfae-e0abdb2d215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:41.364008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:41.417020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8fa19840-432e-42cb-bfae-e0abdb2d215d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:41.418275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8fa19840-432e-42cb-bfae-e0abdb2d215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:41.523711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 691/1365] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:41.818327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b02f6-ad31-4a8a-b723-ac3ac16e53f4 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:41.818610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b02f6-ad31-4a8a-b723-ac3ac16e53f4 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:41.819136 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b02f6-ad31-4a8a-b723-ac3ac16e53f4 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:41.820593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 675/1366] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 22 12:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:41.828036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb80cf-189d-4817-85d4-83b70b9aa032 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:41.834434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb80cf-189d-4817-85d4-83b70b9aa032 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:41.834434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb80cf-189d-4817-85d4-83b70b9aa032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:41.912123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-48cb80cf-189d-4817-85d4-83b70b9aa032 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:41.913497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-48cb80cf-189d-4817-85d4-83b70b9aa032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:41.950036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:42.038232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 692/1367] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 22 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:42.044842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b02f6-ad31-4a8a-b723-ac3ac16e53f4 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:42.046557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-793b02f6-ad31-4a8a-b723-ac3ac16e53f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:42.219088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b02f6-ad31-4a8a-b723-ac3ac16e53f4 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:42.241904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:42.342129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf84fe1-3dda-49e9-b987-0e4395e5ecd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:42.342851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf84fe1-3dda-49e9-b987-0e4395e5ecd8 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:42.343142 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf84fe1-3dda-49e9-b987-0e4395e5ecd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:42.343429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf84fe1-3dda-49e9-b987-0e4395e5ecd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:42.345449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ecf84fe1-3dda-49e9-b987-0e4395e5ecd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:42.447216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf84fe1-3dda-49e9-b987-0e4395e5ecd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:42.449175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf84fe1-3dda-49e9-b987-0e4395e5ecd8 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:42.470585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 676/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:42.982883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583b530-f82d-411f-be07-15f22fbc4bfc None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:42.983428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583b530-f82d-411f-be07-15f22fbc4bfc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:42.983428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583b530-f82d-411f-be07-15f22fbc4bfc None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:42.984980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 693/1369] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:42.990742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579c8a2-39f0-4022-91e5-e6e729e62007 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:42.991032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579c8a2-39f0-4022-91e5-e6e729e62007 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:42.991308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579c8a2-39f0-4022-91e5-e6e729e62007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:43.025069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:43.062724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7579c8a2-39f0-4022-91e5-e6e729e62007 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:43.064324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7579c8a2-39f0-4022-91e5-e6e729e62007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:43.180190 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 677/1370] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:43.766132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71ba0-a348-42ce-a514-087455e1fa45 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:43.766132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71ba0-a348-42ce-a514-087455e1fa45 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:43.766132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71ba0-a348-42ce-a514-087455e1fa45 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:43.769496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 694/1371] 10.222.0.23 () {54 vars in 964 bytes} [Mon Aug 22 12:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:43.773160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc30838-39cc-4dd1-9412-a783ffa09d98 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:43.773681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc30838-39cc-4dd1-9412-a783ffa09d98 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:43.773846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc30838-39cc-4dd1-9412-a783ffa09d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:43.868643 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5bc30838-39cc-4dd1-9412-a783ffa09d98 None None] MFA Rules not processed for user `80696f8fcd8e4d01b303bdfd81a6dc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:43.869865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5bc30838-39cc-4dd1-9412-a783ffa09d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:43.918974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:43.949578 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 678/1372] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Aug 22 12:39:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:43.959461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71ba0-a348-42ce-a514-087455e1fa45 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:43.960967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4cc71ba0-a348-42ce-a514-087455e1fa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:44.070537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71ba0-a348-42ce-a514-087455e1fa45 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:44.113597 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:44.146727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7ece4-af10-42c7-91cb-16c1a0ebc8f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:44.147333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7ece4-af10-42c7-91cb-16c1a0ebc8f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:44.147609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7ece4-af10-42c7-91cb-16c1a0ebc8f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:44.147880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7ece4-af10-42c7-91cb-16c1a0ebc8f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:44.149455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-73f7ece4-af10-42c7-91cb-16c1a0ebc8f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:44.277935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7ece4-af10-42c7-91cb-16c1a0ebc8f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:44.279745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7ece4-af10-42c7-91cb-16c1a0ebc8f2 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:44.304450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 695/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:39:44.679907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61655ea-f88e-4886-8e0f-829f379cd5bd None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:44.680187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61655ea-f88e-4886-8e0f-829f379cd5bd None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:44.680459 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61655ea-f88e-4886-8e0f-829f379cd5bd None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:44.681809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 679/1374] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:44.687014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186f0b5-1bac-463b-a778-20621273c5a8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:44.687327 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186f0b5-1bac-463b-a778-20621273c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:44.687606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186f0b5-1bac-463b-a778-20621273c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:44.754410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c186f0b5-1bac-463b-a778-20621273c5a8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:44.755619 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c186f0b5-1bac-463b-a778-20621273c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:44.776499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:44.851878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 696/1375] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:45.143279 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61655ea-f88e-4886-8e0f-829f379cd5bd None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:45.144815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b61655ea-f88e-4886-8e0f-829f379cd5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:45.300652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61655ea-f88e-4886-8e0f-829f379cd5bd None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:45.354208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:45.416687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046b8e2-bd91-45e0-b837-e56cfe0a3c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:45.417301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046b8e2-bd91-45e0-b837-e56cfe0a3c26 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:45.417583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046b8e2-bd91-45e0-b837-e56cfe0a3c26 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:45.417860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046b8e2-bd91-45e0-b837-e56cfe0a3c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:45.419495 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6046b8e2-bd91-45e0-b837-e56cfe0a3c26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:45.511816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046b8e2-bd91-45e0-b837-e56cfe0a3c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:45.513403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046b8e2-bd91-45e0-b837-e56cfe0a3c26 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:45.533333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 680/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:47.607256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5376f0b-f358-40fa-86ca-d340e0d9fd97 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:47.607784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5376f0b-f358-40fa-86ca-d340e0d9fd97 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:47.607784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5376f0b-f358-40fa-86ca-d340e0d9fd97 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:47.609099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 697/1377] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:47.614423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f9c0-7918-416b-a681-bb17d9bcab8c None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:47.614847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f9c0-7918-416b-a681-bb17d9bcab8c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:47.615006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f9c0-7918-416b-a681-bb17d9bcab8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:47.681757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1963f9c0-7918-416b-a681-bb17d9bcab8c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:47.682983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1963f9c0-7918-416b-a681-bb17d9bcab8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:47.690294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:47.784328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 681/1378] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:48.115658 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5376f0b-f358-40fa-86ca-d340e0d9fd97 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:48.117270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b5376f0b-f358-40fa-86ca-d340e0d9fd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:48.287993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5376f0b-f358-40fa-86ca-d340e0d9fd97 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:48.292055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:48.412507 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc015c-a525-4077-a9f3-0622b23cfc82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:48.413124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc015c-a525-4077-a9f3-0622b23cfc82 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:48.413411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc015c-a525-4077-a9f3-0622b23cfc82 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:48.413680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc015c-a525-4077-a9f3-0622b23cfc82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:48.415298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9acc015c-a525-4077-a9f3-0622b23cfc82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:48.511835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc015c-a525-4077-a9f3-0622b23cfc82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:48.513665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc015c-a525-4077-a9f3-0622b23cfc82 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:48.535188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 698/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:50.613387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866809a-dd80-478a-bae8-a6522dfc461d None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:50.613935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866809a-dd80-478a-bae8-a6522dfc461d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:50.613935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866809a-dd80-478a-bae8-a6522dfc461d None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:50.615461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 682/1380] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:50.620587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1b8ba-c2e7-4da5-9d3a-edae778ae42c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:50.621010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1b8ba-c2e7-4da5-9d3a-edae778ae42c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:50.621179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1b8ba-c2e7-4da5-9d3a-edae778ae42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:50.633306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:50.699207 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-14e1b8ba-c2e7-4da5-9d3a-edae778ae42c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:50.700477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-14e1b8ba-c2e7-4da5-9d3a-edae778ae42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:50.810242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 699/1381] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:51.103711 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866809a-dd80-478a-bae8-a6522dfc461d None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:51.105196 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8866809a-dd80-478a-bae8-a6522dfc461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:51.275492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:51.287644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866809a-dd80-478a-bae8-a6522dfc461d None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:51.414766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838a703-6988-470e-8d2a-9446eb12d755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:51.415376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838a703-6988-470e-8d2a-9446eb12d755 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:51.415656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838a703-6988-470e-8d2a-9446eb12d755 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:51.415924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838a703-6988-470e-8d2a-9446eb12d755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:51.417498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5838a703-6988-470e-8d2a-9446eb12d755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:51.516813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838a703-6988-470e-8d2a-9446eb12d755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:51.518629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838a703-6988-470e-8d2a-9446eb12d755 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:51.529517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:51.538486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 683/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:39:53.634625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106c12-807e-4827-b3d3-e7533adf616a None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:53.635181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106c12-807e-4827-b3d3-e7533adf616a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:53.635181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106c12-807e-4827-b3d3-e7533adf616a None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:53.636554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 700/1383] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:53.641854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a9737-d0b2-4453-a06c-9fb86da1da69 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:53.642298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a9737-d0b2-4453-a06c-9fb86da1da69 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:53.642435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a9737-d0b2-4453-a06c-9fb86da1da69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:53.710704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-cd0a9737-d0b2-4453-a06c-9fb86da1da69 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:53.711913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cd0a9737-d0b2-4453-a06c-9fb86da1da69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:53.810841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 684/1384] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:54.107755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106c12-807e-4827-b3d3-e7533adf616a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:54.109801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-06106c12-807e-4827-b3d3-e7533adf616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:54.212015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:54.273209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106c12-807e-4827-b3d3-e7533adf616a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:54.411203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989202ad-8f80-46a7-af88-5d64002f37e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:54.412259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989202ad-8f80-46a7-af88-5d64002f37e3 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:54.412617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989202ad-8f80-46a7-af88-5d64002f37e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:54.412982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989202ad-8f80-46a7-af88-5d64002f37e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:54.415555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-989202ad-8f80-46a7-af88-5d64002f37e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:54.480822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:54.529616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989202ad-8f80-46a7-af88-5d64002f37e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:54.531254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989202ad-8f80-46a7-af88-5d64002f37e3 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:54.551092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 701/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:56.692607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70920-0327-434d-85cf-f2211e5deac2 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:56.693166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70920-0327-434d-85cf-f2211e5deac2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:56.693261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70920-0327-434d-85cf-f2211e5deac2 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:56.694768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 685/1386] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:56.700181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d379e-74a8-4bfc-b063-078efce4fe32 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:56.700576 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d379e-74a8-4bfc-b063-078efce4fe32 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:56.700738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d379e-74a8-4bfc-b063-078efce4fe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:56.780744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f66d379e-74a8-4bfc-b063-078efce4fe32 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:56.783158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f66d379e-74a8-4bfc-b063-078efce4fe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:56.896190 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 702/1387] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:57.193392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c70920-0327-434d-85cf-f2211e5deac2 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:57.195220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-84c70920-0327-434d-85cf-f2211e5deac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:57.306269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:57.383362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c70920-0327-434d-85cf-f2211e5deac2 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:57.509772 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069769d-a36a-41cd-84d6-b2b2199bf285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:57.510332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069769d-a36a-41cd-84d6-b2b2199bf285 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:57.510617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069769d-a36a-41cd-84d6-b2b2199bf285 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:57.510890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069769d-a36a-41cd-84d6-b2b2199bf285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:57.512485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2069769d-a36a-41cd-84d6-b2b2199bf285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:57.559381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:57.629149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069769d-a36a-41cd-84d6-b2b2199bf285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:57.631518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069769d-a36a-41cd-84d6-b2b2199bf285 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:57.654765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 686/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:59.697056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0e79c-cf74-4a8d-aa91-c5e77def6d69 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:59.697680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0e79c-cf74-4a8d-aa91-c5e77def6d69 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:59.697680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0e79c-cf74-4a8d-aa91-c5e77def6d69 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:59.699131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 703/1389] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:59.705061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ab9f2-f92a-430c-bd4a-114a97a2a852 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:59.705510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ab9f2-f92a-430c-bd4a-114a97a2a852 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:59.705626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ab9f2-f92a-430c-bd4a-114a97a2a852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:59.720547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0ae65-7e6c-4678-883b-413517445914 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:59.720836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0ae65-7e6c-4678-883b-413517445914 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:59.721125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0ae65-7e6c-4678-883b-413517445914 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:59.722494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 704/1390] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:39:59.727363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75088-1c70-4525-be3e-760ae68c8a6d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:59.727641 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75088-1c70-4525-be3e-760ae68c8a6d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:59.727916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75088-1c70-4525-be3e-760ae68c8a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:59.762653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:59.775532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7b1ab9f2-f92a-430c-bd4a-114a97a2a852 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:59.776985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7b1ab9f2-f92a-430c-bd4a-114a97a2a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:59.794904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-edf75088-1c70-4525-be3e-760ae68c8a6d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:59.796056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-edf75088-1c70-4525-be3e-760ae68c8a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:59.876200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 687/1391] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:39:59.895908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 705/1392] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:40:00.179762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f50628-9b22-4317-994a-12190155a363 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:00.180048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f50628-9b22-4317-994a-12190155a363 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:00.180323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f50628-9b22-4317-994a-12190155a363 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:00.181651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 688/1393] 10.222.0.23 () {54 vars in 967 bytes} [Mon Aug 22 12:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:00.184068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf75088-1c70-4525-be3e-760ae68c8a6d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:00.185294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-edf75088-1c70-4525-be3e-760ae68c8a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:00.186847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e8da-41b8-427a-bfc0-5657110d1f93 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:00.187133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e8da-41b8-427a-bfc0-5657110d1f93 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:00.187409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e8da-41b8-427a-bfc0-5657110d1f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:00.204827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:00.265106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-4117e8da-41b8-427a-bfc0-5657110d1f93 None None] MFA Rules not processed for user `a3e56c9d900f4e4e91ea944d4cb0a40a`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:00.266900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-4117e8da-41b8-427a-bfc0-5657110d1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:00.295733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:00.305005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf75088-1c70-4525-be3e-760ae68c8a6d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:00.345857 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 689/1394] 10.222.0.23 () {58 vars in 1064 bytes} [Mon Aug 22 12:40:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:40:00.353432 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e8da-41b8-427a-bfc0-5657110d1f93 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:00.361591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e8da-41b8-427a-bfc0-5657110d1f93 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:00.424188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f27d20-0ce7-49ec-be1c-1e252a64be71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:00.424718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f27d20-0ce7-49ec-be1c-1e252a64be71 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:00.425000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f27d20-0ce7-49ec-be1c-1e252a64be71 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:00.425269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f27d20-0ce7-49ec-be1c-1e252a64be71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:00.426895 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a1f27d20-0ce7-49ec-be1c-1e252a64be71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:00.439045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55414a4-975e-4fd7-a025-bb1799bed84f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e56c9d900f4e4e91ea944d4cb0a40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:00.439655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55414a4-975e-4fd7-a025-bb1799bed84f service glance] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:00.439938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55414a4-975e-4fd7-a025-bb1799bed84f service glance] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:00.440215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55414a4-975e-4fd7-a025-bb1799bed84f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:00.441793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b55414a4-975e-4fd7-a025-bb1799bed84f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:00.472944 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:00.520722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f27d20-0ce7-49ec-be1c-1e252a64be71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:00.522403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f27d20-0ce7-49ec-be1c-1e252a64be71 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:00.539069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:00.542161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 706/1395] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:00.555775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55414a4-975e-4fd7-a025-bb1799bed84f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:00.558847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55414a4-975e-4fd7-a025-bb1799bed84f service glance] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:00.576049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 690/1396] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:40:01.562041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2860f1a-ebc9-48a1-bfe1-cfa9fce133ed None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:01.562582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2860f1a-ebc9-48a1-bfe1-cfa9fce133ed None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:01.562666 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2860f1a-ebc9-48a1-bfe1-cfa9fce133ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:01.630990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f2860f1a-ebc9-48a1-bfe1-cfa9fce133ed None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:01.632221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f2860f1a-ebc9-48a1-bfe1-cfa9fce133ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:01.719626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 707/1397] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:40:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:01.763218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ec837-395c-4540-b135-6ca79d6f323c None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:01.763803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ec837-395c-4540-b135-6ca79d6f323c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:01.763803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ec837-395c-4540-b135-6ca79d6f323c None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:01.765202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 691/1398] 10.222.0.23 () {54 vars in 943 bytes} [Mon Aug 22 12:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:01.772402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b777346-180d-4c46-98ef-de905a768d60 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:01.772700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b777346-180d-4c46-98ef-de905a768d60 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:01.772983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b777346-180d-4c46-98ef-de905a768d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:01.850471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9b777346-180d-4c46-98ef-de905a768d60 None None] MFA Rules not processed for user `656ce4b09cf6425193b7e58562ccaced`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:01.851676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9b777346-180d-4c46-98ef-de905a768d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:01.885781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:01.963635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 708/1399] 10.222.0.23 () {58 vars in 1040 bytes} [Mon Aug 22 12:40:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:01.972976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ec837-395c-4540-b135-6ca79d6f323c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:01.974642 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-813ec837-395c-4540-b135-6ca79d6f323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:02.110309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:02.112682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ec837-395c-4540-b135-6ca79d6f323c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:02.223092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77de964-bdc0-4aca-b411-1115beace337 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:02.223702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77de964-bdc0-4aca-b411-1115beace337 service swift] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:02.223984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77de964-bdc0-4aca-b411-1115beace337 service swift] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:02.224258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77de964-bdc0-4aca-b411-1115beace337 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:02.225880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a77de964-bdc0-4aca-b411-1115beace337 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:02.311736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77de964-bdc0-4aca-b411-1115beace337 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:02.314148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77de964-bdc0-4aca-b411-1115beace337 service swift] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:02.322256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 692/1400] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:40:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:40:02.789902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce179265-eb09-49ad-9779-e02f6c130f24 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:02.790485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce179265-eb09-49ad-9779-e02f6c130f24 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:02.790485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce179265-eb09-49ad-9779-e02f6c130f24 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:02.791863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 709/1401] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:02.798927 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e961-2b3a-45be-8d10-f3d737d5140a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:02.799343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e961-2b3a-45be-8d10-f3d737d5140a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:02.799649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e961-2b3a-45be-8d10-f3d737d5140a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:02.848973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:02.882560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-cc59e961-2b3a-45be-8d10-f3d737d5140a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:02.882560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cc59e961-2b3a-45be-8d10-f3d737d5140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:02.977452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 693/1402] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:03.271348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce179265-eb09-49ad-9779-e02f6c130f24 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:03.272864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ce179265-eb09-49ad-9779-e02f6c130f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:03.441968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce179265-eb09-49ad-9779-e02f6c130f24 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:03.445511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:03.560694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91f1ac-eff3-4a03-8c9b-aaed7a068975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:03.561307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91f1ac-eff3-4a03-8c9b-aaed7a068975 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:03.561591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91f1ac-eff3-4a03-8c9b-aaed7a068975 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:03.561862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91f1ac-eff3-4a03-8c9b-aaed7a068975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:03.563545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fb91f1ac-eff3-4a03-8c9b-aaed7a068975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:03.652239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91f1ac-eff3-4a03-8c9b-aaed7a068975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:03.653841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91f1ac-eff3-4a03-8c9b-aaed7a068975 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:03.671893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 710/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:05.865997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7ba20-4061-4d52-9551-9a160d95a632 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:05.866996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7ba20-4061-4d52-9551-9a160d95a632 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:05.867299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7ba20-4061-4d52-9551-9a160d95a632 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:05.868856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 694/1404] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:05.874603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553c0e2-7b8b-4455-a895-fe718da771db None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:05.875058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553c0e2-7b8b-4455-a895-fe718da771db None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:05.875155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553c0e2-7b8b-4455-a895-fe718da771db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:05.887414 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:05.952407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a553c0e2-7b8b-4455-a895-fe718da771db None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:05.954098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a553c0e2-7b8b-4455-a895-fe718da771db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:06.070153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 711/1405] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:06.376991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7ba20-4061-4d52-9551-9a160d95a632 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:06.379715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9db7ba20-4061-4d52-9551-9a160d95a632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:06.502620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:06.551301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7ba20-4061-4d52-9551-9a160d95a632 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:06.688808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1436cd-cee6-4806-ad39-85b2ad9fa424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:06.689428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1436cd-cee6-4806-ad39-85b2ad9fa424 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:06.689765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1436cd-cee6-4806-ad39-85b2ad9fa424 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:06.690041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1436cd-cee6-4806-ad39-85b2ad9fa424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:06.692910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ba1436cd-cee6-4806-ad39-85b2ad9fa424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:06.784366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:06.805454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1436cd-cee6-4806-ad39-85b2ad9fa424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:06.807149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1436cd-cee6-4806-ad39-85b2ad9fa424 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:06.832127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 695/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:09.007059 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff44cf8-adc7-46fd-937b-0bb1b4954f1e None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:09.007606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff44cf8-adc7-46fd-937b-0bb1b4954f1e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:09.007606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff44cf8-adc7-46fd-937b-0bb1b4954f1e None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:09.008970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 712/1407] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:09.014607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37013c-5efe-4756-adbe-593c3b86e5ad None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:09.015100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37013c-5efe-4756-adbe-593c3b86e5ad None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:09.015235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37013c-5efe-4756-adbe-593c3b86e5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:09.086710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7d37013c-5efe-4756-adbe-593c3b86e5ad None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:09.087918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7d37013c-5efe-4756-adbe-593c3b86e5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:09.222255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 696/1408] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:09.511578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff44cf8-adc7-46fd-937b-0bb1b4954f1e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:09.513689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4ff44cf8-adc7-46fd-937b-0bb1b4954f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:09.621971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:09.693877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff44cf8-adc7-46fd-937b-0bb1b4954f1e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:09.821360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2121b-0694-4631-8f40-37a3e0e881ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:09.821969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2121b-0694-4631-8f40-37a3e0e881ef service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:09.822275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2121b-0694-4631-8f40-37a3e0e881ef service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:09.822552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2121b-0694-4631-8f40-37a3e0e881ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:09.826938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-06e2121b-0694-4631-8f40-37a3e0e881ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:09.883171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:09.930110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2121b-0694-4631-8f40-37a3e0e881ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:09.931993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2121b-0694-4631-8f40-37a3e0e881ef service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:09.951229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 713/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:19.217745 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=79 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:19.949287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=23 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:26.653534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303530-37f1-4311-a253-85cbff1d3e8d None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:26.654079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303530-37f1-4311-a253-85cbff1d3e8d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:26.654079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303530-37f1-4311-a253-85cbff1d3e8d None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:26.655458 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 697/1410] 10.222.0.23 () {54 vars in 918 bytes} [Mon Aug 22 12:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:26.661252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf04b1-7b6a-4784-9b3a-7df230d2b971 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:26.661685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf04b1-7b6a-4784-9b3a-7df230d2b971 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:26.661818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf04b1-7b6a-4784-9b3a-7df230d2b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:26.738382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8ccf04b1-7b6a-4784-9b3a-7df230d2b971 None None] MFA Rules not processed for user `6fa8495c97df48f18b10039584d52f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:26.739582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8ccf04b1-7b6a-4784-9b3a-7df230d2b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:26.848825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 714/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Aug 22 12:40:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:26.863268 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf770-a375-4a1f-8712-67e416fd8e4d None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:26.863664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf770-a375-4a1f-8712-67e416fd8e4d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:26.863974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf770-a375-4a1f-8712-67e416fd8e4d None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:26.865357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 698/1412] 10.222.0.23 () {54 vars in 918 bytes} [Mon Aug 22 12:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:26.870098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c148b98-05e0-460a-bd67-14e0f78693a6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:26.870413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c148b98-05e0-460a-bd67-14e0f78693a6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:26.870689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c148b98-05e0-460a-bd67-14e0f78693a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:26.946790 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:26.949988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5c148b98-05e0-460a-bd67-14e0f78693a6 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:26.951216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5c148b98-05e0-460a-bd67-14e0f78693a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:27.069272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 715/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Aug 22 12:40:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:29.489375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5f00c-2e2e-49ee-b1c0-24e0a8463f95 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:29.489903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5f00c-2e2e-49ee-b1c0-24e0a8463f95 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:29.489903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5f00c-2e2e-49ee-b1c0-24e0a8463f95 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:29.491208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:29.496723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfca68-0366-4c80-9553-77836d3249d8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:29.497164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfca68-0366-4c80-9553-77836d3249d8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:29.497284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfca68-0366-4c80-9553-77836d3249d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:29.563341 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b4cfca68-0366-4c80-9553-77836d3249d8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:29.564554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b4cfca68-0366-4c80-9553-77836d3249d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:29.619711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:29.661570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:29.949353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5f00c-2e2e-49ee-b1c0-24e0a8463f95 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:29.950916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-55c5f00c-2e2e-49ee-b1c0-24e0a8463f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:30.098480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5f00c-2e2e-49ee-b1c0-24e0a8463f95 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:30.172250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:30.214634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596f47-65f8-44d7-b5ff-ded14330fefb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:30.215239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596f47-65f8-44d7-b5ff-ded14330fefb service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:30.215524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596f47-65f8-44d7-b5ff-ded14330fefb service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:30.215802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596f47-65f8-44d7-b5ff-ded14330fefb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:30.217409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-59596f47-65f8-44d7-b5ff-ded14330fefb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:30.307726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596f47-65f8-44d7-b5ff-ded14330fefb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:30.309333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596f47-65f8-44d7-b5ff-ded14330fefb service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:30.327155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 700/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:31.216463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9e187-50e1-4553-aa74-a375bf30b1c4 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:31.217008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9e187-50e1-4553-aa74-a375bf30b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:31.217008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9e187-50e1-4553-aa74-a375bf30b1c4 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:31.218618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:31.223648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f80e-afa6-4438-a6ed-564e1f175bc5 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:31.224050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f80e-afa6-4438-a6ed-564e1f175bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:31.224230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f80e-afa6-4438-a6ed-564e1f175bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:31.299522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ecb2f80e-afa6-4438-a6ed-564e1f175bc5 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:31.300714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ecb2f80e-afa6-4438-a6ed-564e1f175bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:31.328945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:31.399385 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:31.553030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9e187-50e1-4553-aa74-a375bf30b1c4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:31.554570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fbc9e187-50e1-4553-aa74-a375bf30b1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:31.696828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9e187-50e1-4553-aa74-a375bf30b1c4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:31.737144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:31.809664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2121d-d648-482c-ab0d-1e15ef96875e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:31.810210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2121d-d648-482c-ab0d-1e15ef96875e service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:31.810493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2121d-d648-482c-ab0d-1e15ef96875e service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:31.810765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2121d-d648-482c-ab0d-1e15ef96875e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:31.812943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-59a2121d-d648-482c-ab0d-1e15ef96875e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:31.902860 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2121d-d648-482c-ab0d-1e15ef96875e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:31.904455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2121d-d648-482c-ab0d-1e15ef96875e service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:31.923228 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 718/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:32.834678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6087e0-0141-40da-a41e-3ed02f6fa0f1 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:32.835263 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6087e0-0141-40da-a41e-3ed02f6fa0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:32.835263 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6087e0-0141-40da-a41e-3ed02f6fa0f1 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:32.836600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:32.841616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46374c18-674d-461d-a0b6-5b36634307b5 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:32.842061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46374c18-674d-461d-a0b6-5b36634307b5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:32.842183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46374c18-674d-461d-a0b6-5b36634307b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:32.896958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:32.919425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-46374c18-674d-461d-a0b6-5b36634307b5 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:32.920621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-46374c18-674d-461d-a0b6-5b36634307b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:33.018521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:33.179308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6087e0-0141-40da-a41e-3ed02f6fa0f1 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:33.180830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7f6087e0-0141-40da-a41e-3ed02f6fa0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:33.329497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6087e0-0141-40da-a41e-3ed02f6fa0f1 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:33.341709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:33.442805 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745e61d-5123-4c84-8a3a-47c064a62a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:33.443409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745e61d-5123-4c84-8a3a-47c064a62a82 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:33.443693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745e61d-5123-4c84-8a3a-47c064a62a82 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:33.443970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745e61d-5123-4c84-8a3a-47c064a62a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:33.445573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f745e61d-5123-4c84-8a3a-47c064a62a82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:33.536226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745e61d-5123-4c84-8a3a-47c064a62a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:33.537830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745e61d-5123-4c84-8a3a-47c064a62a82 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:33.556565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 703/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:40:34.413298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae8c2-37aa-4dd7-a8ac-bd456ac9a605 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:34.413861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae8c2-37aa-4dd7-a8ac-bd456ac9a605 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:34.413861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae8c2-37aa-4dd7-a8ac-bd456ac9a605 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:34.415261 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:34.420170 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c0a09-a594-41d7-a45b-244b5d009d54 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:34.420593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c0a09-a594-41d7-a45b-244b5d009d54 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:34.420734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c0a09-a594-41d7-a45b-244b5d009d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:34.441872 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:34.499296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-4f6c0a09-a594-41d7-a45b-244b5d009d54 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:34.500823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-4f6c0a09-a594-41d7-a45b-244b5d009d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:34.598070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:34.750058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ae8c2-37aa-4dd7-a8ac-bd456ac9a605 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:34.751716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-861ae8c2-37aa-4dd7-a8ac-bd456ac9a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:34.860350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:34.896102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ae8c2-37aa-4dd7-a8ac-bd456ac9a605 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:35.008052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c16a0-a51a-45b1-a549-b11fb0392f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:35.008605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c16a0-a51a-45b1-a549-b11fb0392f11 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:35.008886 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c16a0-a51a-45b1-a549-b11fb0392f11 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:35.009156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c16a0-a51a-45b1-a549-b11fb0392f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:35.010770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9e6c16a0-a51a-45b1-a549-b11fb0392f11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:35.086582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:35.101215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c16a0-a51a-45b1-a549-b11fb0392f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:35.102861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c16a0-a51a-45b1-a549-b11fb0392f11 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:35.120880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 721/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:35.984497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb98e62-f14f-4e59-b4af-84eb4e2f4d5e None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:35.985441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb98e62-f14f-4e59-b4af-84eb4e2f4d5e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:35.985441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb98e62-f14f-4e59-b4af-84eb4e2f4d5e None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:35.986412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:35.991320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405814f3-018c-4e15-88ea-e81096807378 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:35.991776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405814f3-018c-4e15-88ea-e81096807378 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:35.991876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405814f3-018c-4e15-88ea-e81096807378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:36.067708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-405814f3-018c-4e15-88ea-e81096807378 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:36.068910 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-405814f3-018c-4e15-88ea-e81096807378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:36.164122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:36.324090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb98e62-f14f-4e59-b4af-84eb4e2f4d5e None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:36.325603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6bb98e62-f14f-4e59-b4af-84eb4e2f4d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:36.412781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:36.477298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb98e62-f14f-4e59-b4af-84eb4e2f4d5e None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:36.591380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251f9e2-17de-45c1-9534-d3d59fd33e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:36.591986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251f9e2-17de-45c1-9534-d3d59fd33e8b service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:36.592266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251f9e2-17de-45c1-9534-d3d59fd33e8b service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:36.592540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251f9e2-17de-45c1-9534-d3d59fd33e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:36.594805 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3251f9e2-17de-45c1-9534-d3d59fd33e8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:36.642710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:36.682975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251f9e2-17de-45c1-9534-d3d59fd33e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:36.684568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251f9e2-17de-45c1-9534-d3d59fd33e8b service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:36.704206 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 706/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:37.567407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5d4e4-8295-44c6-b03e-af6f18763621 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:37.567842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5d4e4-8295-44c6-b03e-af6f18763621 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:37.568005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5d4e4-8295-44c6-b03e-af6f18763621 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:37.569420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:37.574429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace20a7e-018c-4fb8-a3b0-c4ce53a73007 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:37.574880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace20a7e-018c-4fb8-a3b0-c4ce53a73007 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:37.574962 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace20a7e-018c-4fb8-a3b0-c4ce53a73007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:37.651427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ace20a7e-018c-4fb8-a3b0-c4ce53a73007 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:37.652638 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ace20a7e-018c-4fb8-a3b0-c4ce53a73007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:37.749986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:37.903981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5d4e4-8295-44c6-b03e-af6f18763621 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:37.905519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0dc5d4e4-8295-44c6-b03e-af6f18763621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:37.954698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:38.052311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5d4e4-8295-44c6-b03e-af6f18763621 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:38.168458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e014d1-9550-4992-b6fe-690f85b18042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:38.169002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e014d1-9550-4992-b6fe-690f85b18042 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:38.169306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e014d1-9550-4992-b6fe-690f85b18042 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:38.169564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e014d1-9550-4992-b6fe-690f85b18042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:38.171215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-84e014d1-9550-4992-b6fe-690f85b18042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:38.179455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:38.264710 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e014d1-9550-4992-b6fe-690f85b18042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:38.266683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e014d1-9550-4992-b6fe-690f85b18042 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:38.286024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 724/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:39.143605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e8a8-801a-45c7-a327-4dc18da0e0f6 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:39.144164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e8a8-801a-45c7-a327-4dc18da0e0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:39.144164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e8a8-801a-45c7-a327-4dc18da0e0f6 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:39.145506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:39.150871 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45a025-0b9b-490a-839b-6758e88b797d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:39.151293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45a025-0b9b-490a-839b-6758e88b797d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:39.156412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45a025-0b9b-490a-839b-6758e88b797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:39.237717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1e45a025-0b9b-490a-839b-6758e88b797d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:39.238974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1e45a025-0b9b-490a-839b-6758e88b797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:39.307254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:39.339012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:39.489319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851e8a8-801a-45c7-a327-4dc18da0e0f6 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:39.490911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3851e8a8-801a-45c7-a327-4dc18da0e0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:39.509590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:39.638179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851e8a8-801a-45c7-a327-4dc18da0e0f6 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:39.724118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:39.749151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8c7a1-222d-4fdd-ae99-f7018558b8e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:39.749759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8c7a1-222d-4fdd-ae99-f7018558b8e2 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:39.750591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8c7a1-222d-4fdd-ae99-f7018558b8e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:39.750864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8c7a1-222d-4fdd-ae99-f7018558b8e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:39.752464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c6b8c7a1-222d-4fdd-ae99-f7018558b8e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:39.841840 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8c7a1-222d-4fdd-ae99-f7018558b8e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:39.843491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8c7a1-222d-4fdd-ae99-f7018558b8e2 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:39.861353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 709/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:40.779228 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887a709-3d48-41ff-a2bf-0d4fcdb4951a None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:40.779804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887a709-3d48-41ff-a2bf-0d4fcdb4951a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:40.779804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887a709-3d48-41ff-a2bf-0d4fcdb4951a None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:40.781152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:40.786158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7154-5ab0-4397-acb7-db5317eec9e3 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:40.786586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7154-5ab0-4397-acb7-db5317eec9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:40.786743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7154-5ab0-4397-acb7-db5317eec9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:40.863087 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-9b4d7154-5ab0-4397-acb7-db5317eec9e3 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:40.864312 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9b4d7154-5ab0-4397-acb7-db5317eec9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:40.904953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:40.961463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:41.115286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887a709-3d48-41ff-a2bf-0d4fcdb4951a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:41.116931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9887a709-3d48-41ff-a2bf-0d4fcdb4951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:41.267040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887a709-3d48-41ff-a2bf-0d4fcdb4951a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:41.321897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:41.381667 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c64b63-902a-4ef9-b997-1c7e71dfe170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:41.382212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c64b63-902a-4ef9-b997-1c7e71dfe170 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:41.382502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c64b63-902a-4ef9-b997-1c7e71dfe170 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:41.382774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c64b63-902a-4ef9-b997-1c7e71dfe170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:41.384372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-20c64b63-902a-4ef9-b997-1c7e71dfe170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:41.473393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c64b63-902a-4ef9-b997-1c7e71dfe170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:41.475049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c64b63-902a-4ef9-b997-1c7e71dfe170 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:41.493392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 727/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:42.335803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c13d-ebeb-4412-92fe-8c6d43001953 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:42.336366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c13d-ebeb-4412-92fe-8c6d43001953 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:42.336366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c13d-ebeb-4412-92fe-8c6d43001953 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:42.337714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:42.342707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce17a-4e7c-4ff9-b899-906106f3a04e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:42.343130 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce17a-4e7c-4ff9-b899-906106f3a04e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:42.343262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce17a-4e7c-4ff9-b899-906106f3a04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:42.418864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b2dce17a-4e7c-4ff9-b899-906106f3a04e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:42.420065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b2dce17a-4e7c-4ff9-b899-906106f3a04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:42.423051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:42.517564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:42.667600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85c13d-ebeb-4412-92fe-8c6d43001953 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:42.669040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9e85c13d-ebeb-4412-92fe-8c6d43001953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:42.816069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85c13d-ebeb-4412-92fe-8c6d43001953 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:42.842157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:42.928456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57563e-e5b7-4668-9ad2-ef069837af5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:42.928963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57563e-e5b7-4668-9ad2-ef069837af5d service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:42.929245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57563e-e5b7-4668-9ad2-ef069837af5d service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:42.929532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57563e-e5b7-4668-9ad2-ef069837af5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:42.931151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ac57563e-e5b7-4668-9ad2-ef069837af5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:43.020729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57563e-e5b7-4668-9ad2-ef069837af5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:43.022447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57563e-e5b7-4668-9ad2-ef069837af5d service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:43.040048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 712/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:44.865880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52452866-4dd8-4303-b048-6109c088b083 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:44.866567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52452866-4dd8-4303-b048-6109c088b083 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:44.866567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52452866-4dd8-4303-b048-6109c088b083 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:44.867907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:44.873439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ca07c-4b67-42c6-87c8-d7717e50078d None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:44.873933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ca07c-4b67-42c6-87c8-d7717e50078d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:44.874047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ca07c-4b67-42c6-87c8-d7717e50078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:44.915675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:44.940287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-9b1ca07c-4b67-42c6-87c8-d7717e50078d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:44.941484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9b1ca07c-4b67-42c6-87c8-d7717e50078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:45.038770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:45.330435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52452866-4dd8-4303-b048-6109c088b083 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:45.331981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-52452866-4dd8-4303-b048-6109c088b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:45.435778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52452866-4dd8-4303-b048-6109c088b083 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:45.467915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:45.511119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77b33-1729-4e91-84a8-2080e5510dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:45.511732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77b33-1729-4e91-84a8-2080e5510dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:45.512018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77b33-1729-4e91-84a8-2080e5510dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:45.512299 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77b33-1729-4e91-84a8-2080e5510dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:45.513906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0ce77b33-1729-4e91-84a8-2080e5510dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:45.621355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77b33-1729-4e91-84a8-2080e5510dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:45.622846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77b33-1729-4e91-84a8-2080e5510dd6 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:45.641554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 730/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:47.720036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad33428-0154-4f99-8f4e-53f14e3da40d None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:47.720662 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad33428-0154-4f99-8f4e-53f14e3da40d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:47.720787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad33428-0154-4f99-8f4e-53f14e3da40d None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:47.723190 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:47.728423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3241-a9f9-49e1-b50b-332f63872c0b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:47.728888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3241-a9f9-49e1-b50b-332f63872c0b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:47.728998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3241-a9f9-49e1-b50b-332f63872c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:47.793643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-db7d3241-a9f9-49e1-b50b-332f63872c0b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:47.794877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-db7d3241-a9f9-49e1-b50b-332f63872c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:47.807955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:47.891419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:48.178147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad33428-0154-4f99-8f4e-53f14e3da40d None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:48.179700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1ad33428-0154-4f99-8f4e-53f14e3da40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:48.284196 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad33428-0154-4f99-8f4e-53f14e3da40d None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:48.296957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:48.365687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e4c3f-4d9f-42d4-875c-6b6eb7cea9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:48.366333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e4c3f-4d9f-42d4-875c-6b6eb7cea9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:48.366615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e4c3f-4d9f-42d4-875c-6b6eb7cea9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:48.366891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e4c3f-4d9f-42d4-875c-6b6eb7cea9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:48.368498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-841e4c3f-4d9f-42d4-875c-6b6eb7cea9f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:48.477234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e4c3f-4d9f-42d4-875c-6b6eb7cea9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:48.478626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e4c3f-4d9f-42d4-875c-6b6eb7cea9f4 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:48.496427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 715/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:50.740399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a8bc7-45d0-4dff-a6b8-b952da941369 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:50.740998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a8bc7-45d0-4dff-a6b8-b952da941369 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:50.740998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a8bc7-45d0-4dff-a6b8-b952da941369 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:50.742341 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:50.747580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3a3d2-f865-4cd1-ae11-3328d859e1c2 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:50.747985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3a3d2-f865-4cd1-ae11-3328d859e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:50.748143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3a3d2-f865-4cd1-ae11-3328d859e1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:50.795830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:50.814355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-10a3a3d2-f865-4cd1-ae11-3328d859e1c2 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:50.815568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-10a3a3d2-f865-4cd1-ae11-3328d859e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:50.911615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:51.203646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a8bc7-45d0-4dff-a6b8-b952da941369 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:51.205281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-934a8bc7-45d0-4dff-a6b8-b952da941369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:51.308531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a8bc7-45d0-4dff-a6b8-b952da941369 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:51.349086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:51.382145 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4601a1-62f8-4713-8a28-8acdf48e324a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:51.382791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4601a1-62f8-4713-8a28-8acdf48e324a service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:51.383078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4601a1-62f8-4713-8a28-8acdf48e324a service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:51.383355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4601a1-62f8-4713-8a28-8acdf48e324a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:51.384972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1c4601a1-62f8-4713-8a28-8acdf48e324a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:51.493624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4601a1-62f8-4713-8a28-8acdf48e324a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:51.495021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4601a1-62f8-4713-8a28-8acdf48e324a service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:51.512528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 733/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:53.541335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2e521-07ed-4f77-81c7-8e5daa712a94 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:53.541887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2e521-07ed-4f77-81c7-8e5daa712a94 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:53.541887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2e521-07ed-4f77-81c7-8e5daa712a94 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:53.543324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:40:53.549297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158907ad-e7eb-4171-b3a3-8feb65735498 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:53.549750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158907ad-e7eb-4171-b3a3-8feb65735498 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:53.549861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158907ad-e7eb-4171-b3a3-8feb65735498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:53.615676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-158907ad-e7eb-4171-b3a3-8feb65735498 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:53.616908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-158907ad-e7eb-4171-b3a3-8feb65735498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:53.637729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:53.713921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:53.997410 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2e521-07ed-4f77-81c7-8e5daa712a94 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:53.999051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f7b2e521-07ed-4f77-81c7-8e5daa712a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:54.103644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2e521-07ed-4f77-81c7-8e5daa712a94 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:54.124064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:54.179815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008f867-5603-447f-af2b-421495d321a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:54.180422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f867-5603-447f-af2b-421495d321a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:54.180702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f867-5603-447f-af2b-421495d321a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:54.180974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f867-5603-447f-af2b-421495d321a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:54.182630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e008f867-5603-447f-af2b-421495d321a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:54.294387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008f867-5603-447f-af2b-421495d321a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:54.295752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008f867-5603-447f-af2b-421495d321a6 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:54.319186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 718/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:56.300124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb55c7e-aec8-4e13-bd9d-a6e69e6d1288 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:56.300656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb55c7e-aec8-4e13-bd9d-a6e69e6d1288 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:56.300758 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb55c7e-aec8-4e13-bd9d-a6e69e6d1288 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:56.302032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:56.307484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1431c53-4804-4c10-bb91-b2400e6900ea None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:56.307916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1431c53-4804-4c10-bb91-b2400e6900ea None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:56.308047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1431c53-4804-4c10-bb91-b2400e6900ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:56.371359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:56.373973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a1431c53-4804-4c10-bb91-b2400e6900ea None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:56.375903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a1431c53-4804-4c10-bb91-b2400e6900ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:56.471655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:56.757066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb55c7e-aec8-4e13-bd9d-a6e69e6d1288 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:56.758638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8fb55c7e-aec8-4e13-bd9d-a6e69e6d1288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:56.862637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb55c7e-aec8-4e13-bd9d-a6e69e6d1288 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:56.912664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:56.938038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9543-22df-4dd6-a709-eff6783f2c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:56.938862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9543-22df-4dd6-a709-eff6783f2c1d service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:56.939354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9543-22df-4dd6-a709-eff6783f2c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:56.939907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9543-22df-4dd6-a709-eff6783f2c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:56.941639 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c52e9543-22df-4dd6-a709-eff6783f2c1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:57.047959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9543-22df-4dd6-a709-eff6783f2c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:57.049320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9543-22df-4dd6-a709-eff6783f2c1d service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:57.068663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 736/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:59.021396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5644c-7b93-4620-b72b-32e0a773fa11 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:59.021985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5644c-7b93-4620-b72b-32e0a773fa11 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:59.021985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5644c-7b93-4620-b72b-32e0a773fa11 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:59.023319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:59.028625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0629dc-eba9-4d51-a5d1-b8c77610bbfc None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:59.029054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0629dc-eba9-4d51-a5d1-b8c77610bbfc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:59.029191 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0629dc-eba9-4d51-a5d1-b8c77610bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:59.095135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-be0629dc-eba9-4d51-a5d1-b8c77610bbfc None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:59.096362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-be0629dc-eba9-4d51-a5d1-b8c77610bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:59.126558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:59.192759 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:59.477621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5644c-7b93-4620-b72b-32e0a773fa11 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:59.479244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-36a5644c-7b93-4620-b72b-32e0a773fa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:59.583569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5644c-7b93-4620-b72b-32e0a773fa11 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:59.612122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:59.657346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e2033-06e3-403a-8d96-f327e2049a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:59.657951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2033-06e3-403a-8d96-f327e2049a81 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:59.658380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2033-06e3-403a-8d96-f327e2049a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:59.658665 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2033-06e3-403a-8d96-f327e2049a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:59.660258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ed7e2033-06e3-403a-8d96-f327e2049a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:59.769057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e2033-06e3-403a-8d96-f327e2049a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:59.770508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e2033-06e3-403a-8d96-f327e2049a81 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:59.789448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 721/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:01.767257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773787c-d582-43bf-9368-0a2e4da39e4f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:01.767838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773787c-d582-43bf-9368-0a2e4da39e4f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:01.767838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773787c-d582-43bf-9368-0a2e4da39e4f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:01.769232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:01.774800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2be16f-c5e4-4e9e-8910-892f84f02db8 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:01.775234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2be16f-c5e4-4e9e-8910-892f84f02db8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:01.775347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2be16f-c5e4-4e9e-8910-892f84f02db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:01.842133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ab2be16f-c5e4-4e9e-8910-892f84f02db8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:01.843520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ab2be16f-c5e4-4e9e-8910-892f84f02db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:01.851976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:01.939500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:02.223121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773787c-d582-43bf-9368-0a2e4da39e4f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:02.224695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1773787c-d582-43bf-9368-0a2e4da39e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:02.328812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773787c-d582-43bf-9368-0a2e4da39e4f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:02.383891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:02.402011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29431a1-10ad-459b-8bc1-7d5ab96ffd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:02.402647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29431a1-10ad-459b-8bc1-7d5ab96ffd88 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:02.402928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29431a1-10ad-459b-8bc1-7d5ab96ffd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:02.403201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29431a1-10ad-459b-8bc1-7d5ab96ffd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:02.404785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e29431a1-10ad-459b-8bc1-7d5ab96ffd88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:02.513460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29431a1-10ad-459b-8bc1-7d5ab96ffd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:02.514859 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29431a1-10ad-459b-8bc1-7d5ab96ffd88 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:02.534443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 739/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:04.503493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b081a-3467-4417-9bdf-f263f59260a9 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:04.504076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b081a-3467-4417-9bdf-f263f59260a9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:04.504076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b081a-3467-4417-9bdf-f263f59260a9 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:04.505379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:04.510793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69601f-18c9-426b-80a7-c95537919d37 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:04.511223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69601f-18c9-426b-80a7-c95537919d37 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:04.511360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69601f-18c9-426b-80a7-c95537919d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:04.578870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ba69601f-18c9-426b-80a7-c95537919d37 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:04.580025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ba69601f-18c9-426b-80a7-c95537919d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:04.618184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:04.676924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:04.973829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b081a-3467-4417-9bdf-f263f59260a9 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:04.975396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d69b081a-3467-4417-9bdf-f263f59260a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:05.079593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b081a-3467-4417-9bdf-f263f59260a9 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:05.117189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:05.153836 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a160512-6e37-4b86-8e53-0053196ce9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:05.154466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a160512-6e37-4b86-8e53-0053196ce9bc service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:05.154744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a160512-6e37-4b86-8e53-0053196ce9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:05.155014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a160512-6e37-4b86-8e53-0053196ce9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:05.157544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8a160512-6e37-4b86-8e53-0053196ce9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:05.269710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a160512-6e37-4b86-8e53-0053196ce9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:05.269710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a160512-6e37-4b86-8e53-0053196ce9bc service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:05.286667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 724/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:07.218904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7937-6ddd-4bd0-a0c8-e12e61f516ff None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:07.219452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7937-6ddd-4bd0-a0c8-e12e61f516ff None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:07.219575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7937-6ddd-4bd0-a0c8-e12e61f516ff None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:07.221196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:07.226641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa634-474e-4c11-b521-74a6d2ec4480 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:07.227051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa634-474e-4c11-b521-74a6d2ec4480 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:07.227168 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa634-474e-4c11-b521-74a6d2ec4480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:07.294414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-f8aaa634-474e-4c11-b521-74a6d2ec4480 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:07.295632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f8aaa634-474e-4c11-b521-74a6d2ec4480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:07.314804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:07.394181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:07.681684 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f7937-6ddd-4bd0-a0c8-e12e61f516ff None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:07.683306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9e5f7937-6ddd-4bd0-a0c8-e12e61f516ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:07.793649 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f7937-6ddd-4bd0-a0c8-e12e61f516ff None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:07.865170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:07.871912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239adcdf-f4ce-4b64-9418-ac2a4111b237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:07.875569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239adcdf-f4ce-4b64-9418-ac2a4111b237 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:07.875569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239adcdf-f4ce-4b64-9418-ac2a4111b237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:07.875569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239adcdf-f4ce-4b64-9418-ac2a4111b237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:07.875569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-239adcdf-f4ce-4b64-9418-ac2a4111b237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:08.001745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239adcdf-f4ce-4b64-9418-ac2a4111b237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:08.003286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239adcdf-f4ce-4b64-9418-ac2a4111b237 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:08.023078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 742/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:10.061408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbcfbf-c313-4faa-8b99-58152cb04287 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:10.061958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbcfbf-c313-4faa-8b99-58152cb04287 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:10.062158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbcfbf-c313-4faa-8b99-58152cb04287 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:10.063642 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:10.068964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b299c9-6f34-4e72-a421-4dea05dcf4b1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:10.069368 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b299c9-6f34-4e72-a421-4dea05dcf4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:10.069531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b299c9-6f34-4e72-a421-4dea05dcf4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:10.135348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-19b299c9-6f34-4e72-a421-4dea05dcf4b1 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:10.136587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-19b299c9-6f34-4e72-a421-4dea05dcf4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:10.189176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:10.237743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:10.519517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbcfbf-c313-4faa-8b99-58152cb04287 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:10.521053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1ebbcfbf-c313-4faa-8b99-58152cb04287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:10.623595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbcfbf-c313-4faa-8b99-58152cb04287 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:10.670806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:10.696909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f021-b5c3-4265-8c3b-466aa9304f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:10.697542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f021-b5c3-4265-8c3b-466aa9304f55 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:10.698023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f021-b5c3-4265-8c3b-466aa9304f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:10.698551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f021-b5c3-4265-8c3b-466aa9304f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:10.700422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1f53f021-b5c3-4265-8c3b-466aa9304f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:10.807322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f021-b5c3-4265-8c3b-466aa9304f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:10.808738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f021-b5c3-4265-8c3b-466aa9304f55 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:10.826605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 727/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:20.235892 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=22 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:20.824380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=66 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:30.346541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d22b4-d88a-4820-bf08-f0562f3fb4e5 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:30.347111 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d22b4-d88a-4820-bf08-f0562f3fb4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:30.347111 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d22b4-d88a-4820-bf08-f0562f3fb4e5 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:30.348494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 744/1471] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:30.353691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4223-118a-438d-bb05-108118e5ab13 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:30.354142 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4223-118a-438d-bb05-108118e5ab13 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:30.354294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4223-118a-438d-bb05-108118e5ab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:30.419544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-d5ee4223-118a-438d-bb05-108118e5ab13 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:30.420770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d5ee4223-118a-438d-bb05-108118e5ab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:30.518055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 728/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:30.819541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba56d-490c-46e1-bfc4-d60ce17145c7 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:30.819830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba56d-490c-46e1-bfc4-d60ce17145c7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:30.820105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba56d-490c-46e1-bfc4-d60ce17145c7 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:30.821444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 745/1473] 10.222.0.23 () {54 vars in 967 bytes} [Mon Aug 22 12:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:30.826483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacf6ae-bc1d-47da-8fc1-93db2c37bb1e None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:30.827376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacf6ae-bc1d-47da-8fc1-93db2c37bb1e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:30.827659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacf6ae-bc1d-47da-8fc1-93db2c37bb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:30.903716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-faacf6ae-bc1d-47da-8fc1-93db2c37bb1e None None] MFA Rules not processed for user `a3e56c9d900f4e4e91ea944d4cb0a40a`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:30.904933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-faacf6ae-bc1d-47da-8fc1-93db2c37bb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:30.925397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:30.981454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 729/1474] 10.222.0.23 () {58 vars in 1064 bytes} [Mon Aug 22 12:41:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:30.989928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fba56d-490c-46e1-bfc4-d60ce17145c7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:30.991517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-24fba56d-490c-46e1-bfc4-d60ce17145c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:31.095681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fba56d-490c-46e1-bfc4-d60ce17145c7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:31.167024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0676d8-5bb6-42db-89fd-fcd3644f8dd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e56c9d900f4e4e91ea944d4cb0a40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:31.167636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0676d8-5bb6-42db-89fd-fcd3644f8dd8 service glance] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:31.167920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0676d8-5bb6-42db-89fd-fcd3644f8dd8 service glance] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:31.168194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0676d8-5bb6-42db-89fd-fcd3644f8dd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:31.169803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7e0676d8-5bb6-42db-89fd-fcd3644f8dd8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:31.225880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:31.280518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0676d8-5bb6-42db-89fd-fcd3644f8dd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:31.281975 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0676d8-5bb6-42db-89fd-fcd3644f8dd8 service glance] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:31.300770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 746/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:33.276617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6604d20-587a-483a-891f-be200643e984 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:33.277166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6604d20-587a-483a-891f-be200643e984 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:33.277284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6604d20-587a-483a-891f-be200643e984 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:33.278584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 730/1476] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:33.284594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e7377-7852-4d2e-ac9e-d42a30973e93 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:33.285049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e7377-7852-4d2e-ac9e-d42a30973e93 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:33.285148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e7377-7852-4d2e-ac9e-d42a30973e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:33.352655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8b4e7377-7852-4d2e-ac9e-d42a30973e93 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:33.353776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8b4e7377-7852-4d2e-ac9e-d42a30973e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:33.453628 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 747/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:33.729146 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6604d20-587a-483a-891f-be200643e984 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:33.730614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a6604d20-587a-483a-891f-be200643e984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:33.856493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6604d20-587a-483a-891f-be200643e984 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:33.905556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:33.950413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f5a6b-d9f1-4fa8-af5b-22bfc078c9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:33.967822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5a6b-d9f1-4fa8-af5b-22bfc078c9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:33.967822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5a6b-d9f1-4fa8-af5b-22bfc078c9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:33.967822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5a6b-d9f1-4fa8-af5b-22bfc078c9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:33.967822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f5a6b-d9f1-4fa8-af5b-22bfc078c9d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:33.967822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WARNING py.warnings [None req-ef5f5a6b-d9f1-4fa8-af5b-22bfc078c9d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:41:33.967822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: warnings.warn(msg) Aug 22 12:41:33.967822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: Aug 22 12:41:33.969265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f5a6b-d9f1-4fa8-af5b-22bfc078c9d2 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:33.974697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 731/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 22 12:41:33 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:41:35.907914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f289-2b1a-4d61-83bb-d60289822967 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:35.908450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f289-2b1a-4d61-83bb-d60289822967 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:35.908450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f289-2b1a-4d61-83bb-d60289822967 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:35.909758 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 748/1479] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:35.915042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81985509-e1de-48d6-89a8-13f05d3fbd16 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:35.915452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81985509-e1de-48d6-89a8-13f05d3fbd16 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:35.915605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81985509-e1de-48d6-89a8-13f05d3fbd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:36.102436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-81985509-e1de-48d6-89a8-13f05d3fbd16 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:36.105993 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-81985509-e1de-48d6-89a8-13f05d3fbd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:36.200582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 732/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:36.497013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0f289-2b1a-4d61-83bb-d60289822967 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:36.499199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-57c0f289-2b1a-4d61-83bb-d60289822967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:36.509052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:36.645584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0f289-2b1a-4d61-83bb-d60289822967 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:36.725450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:36.758300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25d6b6-be08-4b00-af01-65a7be8961d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:36.758913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25d6b6-be08-4b00-af01-65a7be8961d2 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:36.759200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25d6b6-be08-4b00-af01-65a7be8961d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:36.759485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25d6b6-be08-4b00-af01-65a7be8961d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:36.761084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4e25d6b6-be08-4b00-af01-65a7be8961d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:36.850908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25d6b6-be08-4b00-af01-65a7be8961d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:36.852548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25d6b6-be08-4b00-af01-65a7be8961d2 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:36.871055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 749/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:38.978937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea45907-00d2-4d47-b0de-4dbfe52e389d None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:38.979484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea45907-00d2-4d47-b0de-4dbfe52e389d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:38.979581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea45907-00d2-4d47-b0de-4dbfe52e389d None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:38.980857 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 733/1482] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:38.986373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba495c6-2567-4c07-9f63-9a442760c8cf None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:38.986781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba495c6-2567-4c07-9f63-9a442760c8cf None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:38.986927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba495c6-2567-4c07-9f63-9a442760c8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:39.052615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-dba495c6-2567-4c07-9f63-9a442760c8cf None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:39.053807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-dba495c6-2567-4c07-9f63-9a442760c8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:39.103407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:39.154936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 750/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:39.443114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea45907-00d2-4d47-b0de-4dbfe52e389d None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:39.444722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3ea45907-00d2-4d47-b0de-4dbfe52e389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:39.469225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:39.549212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea45907-00d2-4d47-b0de-4dbfe52e389d None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:39.621329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d7e55-f520-4f62-849c-5dae7909e8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:39.621931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d7e55-f520-4f62-849c-5dae7909e8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:39.622233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d7e55-f520-4f62-849c-5dae7909e8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:39.622513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d7e55-f520-4f62-849c-5dae7909e8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:39.624677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f24d7e55-f520-4f62-849c-5dae7909e8e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:39.696809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:39.731937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d7e55-f520-4f62-849c-5dae7909e8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:39.734221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d7e55-f520-4f62-849c-5dae7909e8e2 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:39.751845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 734/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:41.695735 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670efa85-0242-4e36-a481-6d3ba6f6bcee None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:41.696304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670efa85-0242-4e36-a481-6d3ba6f6bcee None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:41.696304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670efa85-0242-4e36-a481-6d3ba6f6bcee None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:41.697638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 751/1485] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:41.703558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb029-40d2-4da4-a3bf-13b91877da2f None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:41.703951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb029-40d2-4da4-a3bf-13b91877da2f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:41.704099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb029-40d2-4da4-a3bf-13b91877da2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:41.778549 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-9bbfb029-40d2-4da4-a3bf-13b91877da2f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:41.780430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9bbfb029-40d2-4da4-a3bf-13b91877da2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:41.875441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 735/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:42.167866 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670efa85-0242-4e36-a481-6d3ba6f6bcee None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:42.169471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-670efa85-0242-4e36-a481-6d3ba6f6bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:42.275918 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670efa85-0242-4e36-a481-6d3ba6f6bcee None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:42.347292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:42.349022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f7f2c-e590-48a9-9f3c-636e3f9b35c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:42.349627 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f7f2c-e590-48a9-9f3c-636e3f9b35c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:42.349907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f7f2c-e590-48a9-9f3c-636e3f9b35c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:42.350210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f7f2c-e590-48a9-9f3c-636e3f9b35c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:42.351816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c37f7f2c-e590-48a9-9f3c-636e3f9b35c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:42.459129 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f7f2c-e590-48a9-9f3c-636e3f9b35c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:42.460557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f7f2c-e590-48a9-9f3c-636e3f9b35c2 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:42.478015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 752/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:44.486314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12880088-356f-426c-829f-7342de385d55 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:44.486860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12880088-356f-426c-829f-7342de385d55 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:44.486860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12880088-356f-426c-829f-7342de385d55 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:44.488218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 736/1488] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:44.493705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316ca0d-d2c3-45a4-9340-0fdceecce509 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:44.494113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316ca0d-d2c3-45a4-9340-0fdceecce509 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:44.494319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316ca0d-d2c3-45a4-9340-0fdceecce509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:44.560344 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7316ca0d-d2c3-45a4-9340-0fdceecce509 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:44.561633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7316ca0d-d2c3-45a4-9340-0fdceecce509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:44.616396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:44.660824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 753/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:44.959878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12880088-356f-426c-829f-7342de385d55 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:44.961395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-12880088-356f-426c-829f-7342de385d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:44.998057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:45.064992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12880088-356f-426c-829f-7342de385d55 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:45.138211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01883fad-181f-473a-8745-90845dd2ae91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:45.138905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01883fad-181f-473a-8745-90845dd2ae91 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:45.139415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01883fad-181f-473a-8745-90845dd2ae91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:45.139712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01883fad-181f-473a-8745-90845dd2ae91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:45.141285 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-01883fad-181f-473a-8745-90845dd2ae91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:45.223860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:45.253013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01883fad-181f-473a-8745-90845dd2ae91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:45.254481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01883fad-181f-473a-8745-90845dd2ae91 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:45.273008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 737/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:47.621286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cf446-efea-48b1-849e-c8fdd4922ab3 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:47.621900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cf446-efea-48b1-849e-c8fdd4922ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:47.621900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cf446-efea-48b1-849e-c8fdd4922ab3 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:47.624023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 754/1491] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 22 12:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:47.629226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bacaf2-ea1c-4e6d-ab37-86c15cb25ca6 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:47.629635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bacaf2-ea1c-4e6d-ab37-86c15cb25ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:47.629800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bacaf2-ea1c-4e6d-ab37-86c15cb25ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:47.695367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-37bacaf2-ea1c-4e6d-ab37-86c15cb25ca6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:47.696599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-37bacaf2-ea1c-4e6d-ab37-86c15cb25ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:47.793578 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 738/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:48.084803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cf446-efea-48b1-849e-c8fdd4922ab3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:48.086420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fa0cf446-efea-48b1-849e-c8fdd4922ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:48.191577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cf446-efea-48b1-849e-c8fdd4922ab3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:48.267270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a084d2-297f-4e5e-9c51-d6a2e614cc06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:48.267811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a084d2-297f-4e5e-9c51-d6a2e614cc06 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:48.268098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a084d2-297f-4e5e-9c51-d6a2e614cc06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:48.268375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a084d2-297f-4e5e-9c51-d6a2e614cc06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:48.269992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-61a084d2-297f-4e5e-9c51-d6a2e614cc06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:48.396007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:48.497834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a084d2-297f-4e5e-9c51-d6a2e614cc06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:48.499889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a084d2-297f-4e5e-9c51-d6a2e614cc06 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:48.517948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 755/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:57.791759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=82 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:58.515600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=50 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:29.328040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb65d9-538b-480d-955b-5e4e4c013ccf None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:29.328906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb65d9-538b-480d-955b-5e4e4c013ccf None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:29.328906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb65d9-538b-480d-955b-5e4e4c013ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:29.404243 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-66cb65d9-538b-480d-955b-5e4e4c013ccf None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:43:29.405489 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-66cb65d9-538b-480d-955b-5e4e4c013ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:29.501568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 739/1494] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:43:29.509683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d40d5-5864-41da-8055-14aa1155aea2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:29.510185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d40d5-5864-41da-8055-14aa1155aea2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:29.510331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d40d5-5864-41da-8055-14aa1155aea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:29.586277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c77d40d5-5864-41da-8055-14aa1155aea2 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:43:29.587469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c77d40d5-5864-41da-8055-14aa1155aea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:29.685800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 756/1495] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:43:29.690546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb65d9-538b-480d-955b-5e4e4c013ccf None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:29.691738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-66cb65d9-538b-480d-955b-5e4e4c013ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:29.703389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb65d9-538b-480d-955b-5e4e4c013ccf None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:29.762657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:29.797572 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:29.798179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:29.798492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:29.798766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:29.799406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:43:29.799711 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:29.800789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WARNING py.warnings [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:29.800789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: warnings.warn(msg) Aug 22 12:43:29.800789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: Aug 22 12:43:29.801669 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:29.813503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 740/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:43:29.821764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d40d5-5864-41da-8055-14aa1155aea2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:29.831750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d40d5-5864-41da-8055-14aa1155aea2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:29.893112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:29.925625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf22e-2671-4bf4-8d2b-a535968788cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:29.926266 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf22e-2671-4bf4-8d2b-a535968788cf admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:29.926552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf22e-2671-4bf4-8d2b-a535968788cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:29.926829 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf22e-2671-4bf4-8d2b-a535968788cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:29.927449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf22e-2671-4bf4-8d2b-a535968788cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:29.929180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-35cdf22e-2671-4bf4-8d2b-a535968788cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:29.929180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: warnings.warn(msg) Aug 22 12:43:29.929180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: Aug 22 12:43:29.930393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf22e-2671-4bf4-8d2b-a535968788cf admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:30.078119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 757/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:43:29 2022] POST /identity/v3/projects => generated 375 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:43:30.082673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:30.084184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:30.116335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae58744-f576-4272-a02c-bd896b798a52 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:30.211161 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab72027-418f-462b-83d7-e5aa03fef3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:30.211770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72027-418f-462b-83d7-e5aa03fef3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.212052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72027-418f-462b-83d7-e5aa03fef3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.212327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72027-418f-462b-83d7-e5aa03fef3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:30.212955 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab72027-418f-462b-83d7-e5aa03fef3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:30.213977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WARNING py.warnings [None req-3ab72027-418f-462b-83d7-e5aa03fef3a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:30.213977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: warnings.warn(msg) Aug 22 12:43:30.213977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: Aug 22 12:43:30.215203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab72027-418f-462b-83d7-e5aa03fef3a9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:30.360808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 741/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:43:30 2022] POST /identity/v3/users => generated 288 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:43:30.365134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf22e-2671-4bf4-8d2b-a535968788cf admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:30.367427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-35cdf22e-2671-4bf4-8d2b-a535968788cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:30.428121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf22e-2671-4bf4-8d2b-a535968788cf admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:30.511165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:30.521972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b881f-ac84-4b5f-a32a-b3010a4af8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:30.522678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b881f-ac84-4b5f-a32a-b3010a4af8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.522990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b881f-ac84-4b5f-a32a-b3010a4af8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.523268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b881f-ac84-4b5f-a32a-b3010a4af8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:30.523906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b881f-ac84-4b5f-a32a-b3010a4af8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:30.524927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-d97b881f-ac84-4b5f-a32a-b3010a4af8e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:30.524927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: warnings.warn(msg) Aug 22 12:43:30.524927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: Aug 22 12:43:30.525803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b881f-ac84-4b5f-a32a-b3010a4af8e3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:30.538895 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 758/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:43:30.543035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab72027-418f-462b-83d7-e5aa03fef3a9 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:30.545264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3ab72027-418f-462b-83d7-e5aa03fef3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:30.556689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab72027-418f-462b-83d7-e5aa03fef3a9 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:30.582921 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:30.651971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b3131-590c-49ee-8574-7545c95878c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:30.652500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b3131-590c-49ee-8574-7545c95878c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.652778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b3131-590c-49ee-8574-7545c95878c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.653045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b3131-590c-49ee-8574-7545c95878c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:30.654269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b3131-590c-49ee-8574-7545c95878c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:30.655401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WARNING py.warnings [None req-a40b3131-590c-49ee-8574-7545c95878c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:30.655401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: warnings.warn(msg) Aug 22 12:43:30.655401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: Aug 22 12:43:30.656279 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b3131-590c-49ee-8574-7545c95878c1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:30.668746 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 742/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:43:30.673775 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b881f-ac84-4b5f-a32a-b3010a4af8e3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:30.675326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d97b881f-ac84-4b5f-a32a-b3010a4af8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:30.719192 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b881f-ac84-4b5f-a32a-b3010a4af8e3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:30.813450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef1b7f-3f0b-4c26-a777-55f0ceb75239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:30.814108 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1b7f-3f0b-4c26-a777-55f0ceb75239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.814418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1b7f-3f0b-4c26-a777-55f0ceb75239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.814693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1b7f-3f0b-4c26-a777-55f0ceb75239 admin admin] PATH_INFO: `/v3/projects/8d11c45b224849cd9b52dda4a6361595/users/29cfa79a91e34d3c8921ba305519b34b/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:30.836399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef1b7f-3f0b-4c26-a777-55f0ceb75239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d11c45b224849cd9b52dda4a6361595, user_id=29cfa79a91e34d3c8921ba305519b34b, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:30.837436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-abef1b7f-3f0b-4c26-a777-55f0ceb75239 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:30.837436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: warnings.warn(msg) Aug 22 12:43:30.837436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: Aug 22 12:43:30.839401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef1b7f-3f0b-4c26-a777-55f0ceb75239 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:30.936084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 759/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:43:30 2022] PUT /identity/v3/projects/8d11c45b224849cd9b52dda4a6361595/users/29cfa79a91e34d3c8921ba305519b34b/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:43:30.948207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028bf48-ed79-4356-b464-fc11cc708b30 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.948498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028bf48-ed79-4356-b464-fc11cc708b30 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.948779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028bf48-ed79-4356-b464-fc11cc708b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.006787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-4028bf48-ed79-4356-b464-fc11cc708b30 None None] MFA Rules not processed for user `29cfa79a91e34d3c8921ba305519b34b`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:43:31.007962 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-4028bf48-ed79-4356-b464-fc11cc708b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:31.086845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 743/1502] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:43:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:43:31.101204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0949fe-101b-4b0e-841f-7778dd8d269b None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:31.101497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0949fe-101b-4b0e-841f-7778dd8d269b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:31.101780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0949fe-101b-4b0e-841f-7778dd8d269b None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.103200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 760/1503] 10.222.0.23 () {54 vars in 964 bytes} [Mon Aug 22 12:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:43:31.108616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931763bb-1623-4f2e-b881-21772b937394 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:31.108902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931763bb-1623-4f2e-b881-21772b937394 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:31.109219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931763bb-1623-4f2e-b881-21772b937394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.140947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:31.186471 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-931763bb-1623-4f2e-b881-21772b937394 None None] MFA Rules not processed for user `80696f8fcd8e4d01b303bdfd81a6dc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:43:31.187616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-931763bb-1623-4f2e-b881-21772b937394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:31.264748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 744/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Aug 22 12:43:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:43:31.272560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0949fe-101b-4b0e-841f-7778dd8d269b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:31.274151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5f0949fe-101b-4b0e-841f-7778dd8d269b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:31.326675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:31.379348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0949fe-101b-4b0e-841f-7778dd8d269b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:31.456811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dea3b3-d4a3-41e6-8def-7723bb89e6ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:31.457334 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dea3b3-d4a3-41e6-8def-7723bb89e6ae service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:31.457613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dea3b3-d4a3-41e6-8def-7723bb89e6ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:31.457881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dea3b3-d4a3-41e6-8def-7723bb89e6ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.459504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-38dea3b3-d4a3-41e6-8def-7723bb89e6ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:31.556913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dea3b3-d4a3-41e6-8def-7723bb89e6ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:31.558378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dea3b3-d4a3-41e6-8def-7723bb89e6ae service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:31.563352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:31.579163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 761/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:43:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:43:31.624361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d349f9-006c-46dc-a02e-05ccc226a95a None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:31.624794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d349f9-006c-46dc-a02e-05ccc226a95a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:31.624903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d349f9-006c-46dc-a02e-05ccc226a95a None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.626142 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 745/1506] 10.222.0.23 () {52 vars in 830 bytes} [Mon Aug 22 12:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:43:31.629640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dea3b3-d4a3-41e6-8def-7723bb89e6ae service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:31.630888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-38dea3b3-d4a3-41e6-8def-7723bb89e6ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:31.728648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dea3b3-d4a3-41e6-8def-7723bb89e6ae service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:31.821663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:31.822321 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:31.822601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:31.822873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] PATH_INFO: `/v3/users/29cfa79a91e34d3c8921ba305519b34b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.835475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29cfa79a91e34d3c8921ba305519b34b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:31.836501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:31.836501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: warnings.warn(msg) Aug 22 12:43:31.836501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: Aug 22 12:43:31.837707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:31.847190 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:32.053128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29cfa79a91e34d3c8921ba305519b34b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:32.053564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29cfa79a91e34d3c8921ba305519b34b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:32.067852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29cfa79a91e34d3c8921ba305519b34b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:32.089781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29cfa79a91e34d3c8921ba305519b34b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:32.167251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29cfa79a91e34d3c8921ba305519b34b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:32.174421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 762/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:43:31 2022] DELETE /identity/v3/users/29cfa79a91e34d3c8921ba305519b34b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:43:32.178670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913701-7788-466d-815a-2b4e7058304f None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:32.178961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913701-7788-466d-815a-2b4e7058304f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:32.181488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913701-7788-466d-815a-2b4e7058304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:32.238889 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-83913701-7788-466d-815a-2b4e7058304f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:43:32.240084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-83913701-7788-466d-815a-2b4e7058304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:32.314687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:32.327052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 746/1508] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:43:32.337141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:32.338469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:32.438620 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a9d23-3b57-49e1-ab9b-f6a36f62b71a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:32.493493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:32.512264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db587-2383-4a87-8283-9d711fa7ed8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:32.512885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db587-2383-4a87-8283-9d711fa7ed8f service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:32.513915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db587-2383-4a87-8283-9d711fa7ed8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:32.514472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db587-2383-4a87-8283-9d711fa7ed8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:32.516198 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b96db587-2383-4a87-8283-9d711fa7ed8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:32.626050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db587-2383-4a87-8283-9d711fa7ed8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:32.627498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db587-2383-4a87-8283-9d711fa7ed8f service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:32.645756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 763/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:43:33.095266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83913701-7788-466d-815a-2b4e7058304f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:33.096582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-83913701-7788-466d-815a-2b4e7058304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:33.108482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83913701-7788-466d-815a-2b4e7058304f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:33.212321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:33.212952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:33.213233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:33.213506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] PATH_INFO: `/v3/projects/8d11c45b224849cd9b52dda4a6361595` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:33.224359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d11c45b224849cd9b52dda4a6361595)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:33.225379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WARNING py.warnings [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:33.225379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: warnings.warn(msg) Aug 22 12:43:33.225379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: Aug 22 12:43:33.226649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:33.344592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d11c45b224849cd9b52dda4a6361595', 'request_id': 'req-fc8a6243-0b6e-46a3-ac14-f178084aa06f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:33.418899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d11c45b224849cd9b52dda4a6361595', 'request_id': 'req-fc8a6243-0b6e-46a3-ac14-f178084aa06f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:33.425322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d11c45b224849cd9b52dda4a6361595', 'request_id': 'req-fc8a6243-0b6e-46a3-ac14-f178084aa06f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:33.456425 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] The token cache is being invalidate because project 8d11c45b224849cd9b52dda4a6361595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:43:33.456717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:33.457249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc8a6243-0b6e-46a3-ac14-f178084aa06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:33.458774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 747/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:43:33 2022] DELETE /identity/v3/projects/8d11c45b224849cd9b52dda4a6361595 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:43:42.643551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=62 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:43.455783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:08.788609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632cca-9069-4cf7-8c96-1eeee598bb9f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:08.789248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632cca-9069-4cf7-8c96-1eeee598bb9f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:08.789248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632cca-9069-4cf7-8c96-1eeee598bb9f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:08.790610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:08.795487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89b5b-397a-43a8-9e4e-e21cf22828b9 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:08.795931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89b5b-397a-43a8-9e4e-e21cf22828b9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:08.796039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89b5b-397a-43a8-9e4e-e21cf22828b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:08.878637 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e1a89b5b-397a-43a8-9e4e-e21cf22828b9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:08.879898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e1a89b5b-397a-43a8-9e4e-e21cf22828b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:08.983393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:09.139546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98632cca-9069-4cf7-8c96-1eeee598bb9f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:09.141630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-98632cca-9069-4cf7-8c96-1eeee598bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:09.260026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98632cca-9069-4cf7-8c96-1eeee598bb9f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:09.265468 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd5d49-3270-4a45-a80f-9b967fd1ceb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:09.266079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd5d49-3270-4a45-a80f-9b967fd1ceb3 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:09.266390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd5d49-3270-4a45-a80f-9b967fd1ceb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:09.266669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd5d49-3270-4a45-a80f-9b967fd1ceb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:09.275257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd5d49-3270-4a45-a80f-9b967fd1ceb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:09.276950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd5d49-3270-4a45-a80f-9b967fd1ceb3 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:09.286356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 765/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:10.118620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e03c6-5b6f-4820-b41a-dfa417d94474 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:10.119100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e03c6-5b6f-4820-b41a-dfa417d94474 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:10.119211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e03c6-5b6f-4820-b41a-dfa417d94474 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:10.120498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:45:10.125539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94460d8-7278-45dc-b38a-ece940443263 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:10.125923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94460d8-7278-45dc-b38a-ece940443263 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:10.126108 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94460d8-7278-45dc-b38a-ece940443263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:10.145992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d94460d8-7278-45dc-b38a-ece940443263 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:10.147874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d94460d8-7278-45dc-b38a-ece940443263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:10.155730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:10.309487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e03c6-5b6f-4820-b41a-dfa417d94474 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:10.326849 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e03c6-5b6f-4820-b41a-dfa417d94474 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:10.332615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443f470-d1a1-4569-98ff-65db1e658928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:10.333163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f470-d1a1-4569-98ff-65db1e658928 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:10.333472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f470-d1a1-4569-98ff-65db1e658928 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:10.333799 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f470-d1a1-4569-98ff-65db1e658928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:10.344481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443f470-d1a1-4569-98ff-65db1e658928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:10.346210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443f470-d1a1-4569-98ff-65db1e658928 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:10.356888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 750/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:10.405458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010606b0-0ab1-4aa0-890d-191c1193f7ec None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:10.405746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010606b0-0ab1-4aa0-890d-191c1193f7ec None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:10.406024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010606b0-0ab1-4aa0-890d-191c1193f7ec None None] PATH_INFO: `/v3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:10.407416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 767/1517] 10.222.0.47 () {54 vars in 925 bytes} [Mon Aug 22 12:45:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:45:10.414862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9cdc2-cf75-477f-8d97-af604484e5f1 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:10.415148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9cdc2-cf75-477f-8d97-af604484e5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:10.415422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9cdc2-cf75-477f-8d97-af604484e5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:10.479600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-23b9cdc2-cf75-477f-8d97-af604484e5f1 None None] MFA Rules not processed for user `6fa8495c97df48f18b10039584d52f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:10.480816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-23b9cdc2-cf75-477f-8d97-af604484e5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:10.498885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:10.557560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 751/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Aug 22 12:45:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:19.889169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf1127-205b-44db-a7b1-db94eab819d2 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:19.889695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf1127-205b-44db-a7b1-db94eab819d2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:19.889695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf1127-205b-44db-a7b1-db94eab819d2 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:19.891013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 768/1519] 10.222.0.23 () {54 vars in 961 bytes} [Mon Aug 22 12:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:19.896578 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285be716-5b62-4ec1-a0ba-8655c45e4b3d None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:19.896992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285be716-5b62-4ec1-a0ba-8655c45e4b3d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:19.897158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285be716-5b62-4ec1-a0ba-8655c45e4b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:19.916273 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-285be716-5b62-4ec1-a0ba-8655c45e4b3d None None] MFA Rules not processed for user `6fa8495c97df48f18b10039584d52f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:19.917456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-285be716-5b62-4ec1-a0ba-8655c45e4b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:19.925743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 752/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Aug 22 12:45:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:19.933026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf1127-205b-44db-a7b1-db94eab819d2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:19.947410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf1127-205b-44db-a7b1-db94eab819d2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:19.952316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c97fd6-1171-4018-a4a1-a469f1d37e04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8495c97df48f18b10039584d52f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:19.952913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c97fd6-1171-4018-a4a1-a469f1d37e04 service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:19.953200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c97fd6-1171-4018-a4a1-a469f1d37e04 service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:19.953481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c97fd6-1171-4018-a4a1-a469f1d37e04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:19.962645 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c97fd6-1171-4018-a4a1-a469f1d37e04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:19.964230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c97fd6-1171-4018-a4a1-a469f1d37e04 service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:19.973724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 769/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:21.605261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0878a-5565-4551-8425-eb452ad32d07 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:21.605956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0878a-5565-4551-8425-eb452ad32d07 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:21.605956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0878a-5565-4551-8425-eb452ad32d07 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:21.607240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:21.612108 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd0df5-94a7-40a5-a30a-8c84dd7beed0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:21.612554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd0df5-94a7-40a5-a30a-8c84dd7beed0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:21.612668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd0df5-94a7-40a5-a30a-8c84dd7beed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:21.632225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-13fd0df5-94a7-40a5-a30a-8c84dd7beed0 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:21.633407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-13fd0df5-94a7-40a5-a30a-8c84dd7beed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:21.641131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:21.795284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0878a-5565-4551-8425-eb452ad32d07 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:21.809973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0878a-5565-4551-8425-eb452ad32d07 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:21.815336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2316f-46b2-4859-bf5d-c080174c8591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:21.815929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2316f-46b2-4859-bf5d-c080174c8591 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:21.816211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2316f-46b2-4859-bf5d-c080174c8591 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:21.816488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2316f-46b2-4859-bf5d-c080174c8591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:21.824995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2316f-46b2-4859-bf5d-c080174c8591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:21.826602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2316f-46b2-4859-bf5d-c080174c8591 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:21.836132 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 754/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:22.652262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47741a-cefc-4ce6-981f-06eeb5b17c52 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:22.652853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47741a-cefc-4ce6-981f-06eeb5b17c52 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:22.652853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47741a-cefc-4ce6-981f-06eeb5b17c52 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:22.654159 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:22.659125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417f0f9-b648-477d-bad9-f424db260c5b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:22.659565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417f0f9-b648-477d-bad9-f424db260c5b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:22.659675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417f0f9-b648-477d-bad9-f424db260c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:22.679134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-4417f0f9-b648-477d-bad9-f424db260c5b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:22.680338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-4417f0f9-b648-477d-bad9-f424db260c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:22.689195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:22.840962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47741a-cefc-4ce6-981f-06eeb5b17c52 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:22.855744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47741a-cefc-4ce6-981f-06eeb5b17c52 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:22.861128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efb139-7540-403b-839f-4843f58b04b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:22.861730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efb139-7540-403b-839f-4843f58b04b9 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:22.862013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efb139-7540-403b-839f-4843f58b04b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:22.862330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efb139-7540-403b-839f-4843f58b04b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:22.870790 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efb139-7540-403b-839f-4843f58b04b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:22.872378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efb139-7540-403b-839f-4843f58b04b9 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:22.881598 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 772/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:26.830453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcaf72-651d-40c2-ae4b-eedc4b231d38 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:26.831032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcaf72-651d-40c2-ae4b-eedc4b231d38 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:26.831032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcaf72-651d-40c2-ae4b-eedc4b231d38 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:26.832488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:26.838576 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7701390-029c-4c44-8971-779a230b4c85 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:26.839045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7701390-029c-4c44-8971-779a230b4c85 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:26.839163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7701390-029c-4c44-8971-779a230b4c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:26.859444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b7701390-029c-4c44-8971-779a230b4c85 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:26.860787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b7701390-029c-4c44-8971-779a230b4c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:26.868784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:27.152048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcaf72-651d-40c2-ae4b-eedc4b231d38 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:27.153764 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8fdcaf72-651d-40c2-ae4b-eedc4b231d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:27.231928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcaf72-651d-40c2-ae4b-eedc4b231d38 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:27.235594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb3372-d521-444f-9862-df6d3c0d20aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:27.236205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3372-d521-444f-9862-df6d3c0d20aa service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:27.236491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3372-d521-444f-9862-df6d3c0d20aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:27.236769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3372-d521-444f-9862-df6d3c0d20aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:27.246279 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb3372-d521-444f-9862-df6d3c0d20aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:27.247699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb3372-d521-444f-9862-df6d3c0d20aa service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:27.257144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 757/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:29.202210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac0a30-2d1b-4246-8db6-28a666a22f72 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:29.202703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac0a30-2d1b-4246-8db6-28a666a22f72 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:29.202812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac0a30-2d1b-4246-8db6-28a666a22f72 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:29.204662 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:29.209937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0edcb9-addb-4974-a23b-c4b1c9ed7e75 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:29.210405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0edcb9-addb-4974-a23b-c4b1c9ed7e75 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:29.210510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0edcb9-addb-4974-a23b-c4b1c9ed7e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:29.229466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-bc0edcb9-addb-4974-a23b-c4b1c9ed7e75 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:29.230686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bc0edcb9-addb-4974-a23b-c4b1c9ed7e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:29.238253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:45:29.522881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac0a30-2d1b-4246-8db6-28a666a22f72 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:29.533695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac0a30-2d1b-4246-8db6-28a666a22f72 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:29.538023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030ae3b-b22e-44f2-8d17-a4e9e0a9ebe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:29.538939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ae3b-b22e-44f2-8d17-a4e9e0a9ebe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:29.538939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ae3b-b22e-44f2-8d17-a4e9e0a9ebe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:29.539182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ae3b-b22e-44f2-8d17-a4e9e0a9ebe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:29.547962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030ae3b-b22e-44f2-8d17-a4e9e0a9ebe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:29.549383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030ae3b-b22e-44f2-8d17-a4e9e0a9ebe3 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:29.559285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 775/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:32.960879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fb3e8-08db-4a87-81fe-5abb8136904f None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:32.961419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fb3e8-08db-4a87-81fe-5abb8136904f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:32.961419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fb3e8-08db-4a87-81fe-5abb8136904f None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:32.962847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:32.968129 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a867a1-ae27-4ec2-af5d-cb928fbe47c9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:32.968538 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a867a1-ae27-4ec2-af5d-cb928fbe47c9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:32.968688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a867a1-ae27-4ec2-af5d-cb928fbe47c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:32.977122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=81 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:32.988811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-63a867a1-ae27-4ec2-af5d-cb928fbe47c9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:32.993615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-63a867a1-ae27-4ec2-af5d-cb928fbe47c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:32.998208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:33.546805 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fb3e8-08db-4a87-81fe-5abb8136904f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:33.550714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bd5fb3e8-08db-4a87-81fe-5abb8136904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:33.615052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:33.628026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fb3e8-08db-4a87-81fe-5abb8136904f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:33.631682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1a520-51cc-4f54-9291-0aa702664f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:33.636597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a520-51cc-4f54-9291-0aa702664f1e service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:33.636597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a520-51cc-4f54-9291-0aa702664f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:33.636597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a520-51cc-4f54-9291-0aa702664f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:33.641947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1a520-51cc-4f54-9291-0aa702664f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:33.643470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1a520-51cc-4f54-9291-0aa702664f1e service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:33.653201 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 760/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:35.596004 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1cab6-dcaa-42a8-ab14-7e34ed80e2e1 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:35.596604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1cab6-dcaa-42a8-ab14-7e34ed80e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:35.596604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1cab6-dcaa-42a8-ab14-7e34ed80e2e1 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:35.597892 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:35.603496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5349b9b-8150-4802-8803-0fcc04063ba6 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:35.603961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5349b9b-8150-4802-8803-0fcc04063ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:35.604507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5349b9b-8150-4802-8803-0fcc04063ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:35.623325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-d5349b9b-8150-4802-8803-0fcc04063ba6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:35.624526 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d5349b9b-8150-4802-8803-0fcc04063ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:35.633071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:45:36.186814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1cab6-dcaa-42a8-ab14-7e34ed80e2e1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:36.195078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b9d1cab6-dcaa-42a8-ab14-7e34ed80e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:36.201263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1cab6-dcaa-42a8-ab14-7e34ed80e2e1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:36.205168 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c4d05-39a7-4726-8711-e6e8cb5c78c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:36.205772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c4d05-39a7-4726-8711-e6e8cb5c78c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:36.206056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c4d05-39a7-4726-8711-e6e8cb5c78c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:36.206361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c4d05-39a7-4726-8711-e6e8cb5c78c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:36.216061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c4d05-39a7-4726-8711-e6e8cb5c78c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:36.218344 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c4d05-39a7-4726-8711-e6e8cb5c78c5 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:36.228037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 778/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:45.618567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=11 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:46.223108 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=8 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:03.979688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200d8c-c5b2-44ee-a162-bc845f19b83b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:03.982862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200d8c-c5b2-44ee-a162-bc845f19b83b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:03.982862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200d8c-c5b2-44ee-a162-bc845f19b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.010421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-64200d8c-c5b2-44ee-a162-bc845f19b83b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.011657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-64200d8c-c5b2-44ee-a162-bc845f19b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.024062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 762/1540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.033530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16a329-7754-4485-96f3-dcf962bb08d6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.034452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16a329-7754-4485-96f3-dcf962bb08d6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.034452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16a329-7754-4485-96f3-dcf962bb08d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.060322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1e16a329-7754-4485-96f3-dcf962bb08d6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.061562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1e16a329-7754-4485-96f3-dcf962bb08d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.075293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 779/1541] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.080825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64200d8c-c5b2-44ee-a162-bc845f19b83b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.092795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64200d8c-c5b2-44ee-a162-bc845f19b83b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.102017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb45191-08f8-48e4-b4c0-a8b2813c15f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.102689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45191-08f8-48e4-b4c0-a8b2813c15f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.102972 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45191-08f8-48e4-b4c0-a8b2813c15f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.103250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45191-08f8-48e4-b4c0-a8b2813c15f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.104008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb45191-08f8-48e4-b4c0-a8b2813c15f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:04.104303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb45191-08f8-48e4-b4c0-a8b2813c15f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.105965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb45191-08f8-48e4-b4c0-a8b2813c15f1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.126781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 763/1542] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:04.136036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16a329-7754-4485-96f3-dcf962bb08d6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.153160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16a329-7754-4485-96f3-dcf962bb08d6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.163178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf78091-3ebc-4ada-945d-59fdc1aa31e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.164089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf78091-3ebc-4ada-945d-59fdc1aa31e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.164494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf78091-3ebc-4ada-945d-59fdc1aa31e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.164780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf78091-3ebc-4ada-945d-59fdc1aa31e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.165452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf78091-3ebc-4ada-945d-59fdc1aa31e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.167529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf78091-3ebc-4ada-945d-59fdc1aa31e3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.307687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 780/1543] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:04.311913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb45191-08f8-48e4-b4c0-a8b2813c15f1 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.321319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d479261-fbc4-4c00-b6cb-c089b7a66aba None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.321642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d479261-fbc4-4c00-b6cb-c089b7a66aba None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.321895 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d479261-fbc4-4c00-b6cb-c089b7a66aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.324009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb45191-08f8-48e4-b4c0-a8b2813c15f1 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.348829 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9d479261-fbc4-4c00-b6cb-c089b7a66aba None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.350072 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9d479261-fbc4-4c00-b6cb-c089b7a66aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.423759 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 781/1544] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.425074 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a684a-20d8-4423-a623-81e1b5d22f2c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.425366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a684a-20d8-4423-a623-81e1b5d22f2c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.425647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a684a-20d8-4423-a623-81e1b5d22f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.443304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e108710-2749-4cf5-a0ac-6d6c0a08feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.443930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108710-2749-4cf5-a0ac-6d6c0a08feb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.444214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108710-2749-4cf5-a0ac-6d6c0a08feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.444492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108710-2749-4cf5-a0ac-6d6c0a08feb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.445712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e108710-2749-4cf5-a0ac-6d6c0a08feb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.447674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e108710-2749-4cf5-a0ac-6d6c0a08feb8 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.465386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-491a684a-20d8-4423-a623-81e1b5d22f2c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.466590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-491a684a-20d8-4423-a623-81e1b5d22f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.478226 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 782/1545] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.479541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec5429-dc99-4e10-81f7-20ef7747817c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.479838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec5429-dc99-4e10-81f7-20ef7747817c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.480125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec5429-dc99-4e10-81f7-20ef7747817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.501393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d8ec5429-dc99-4e10-81f7-20ef7747817c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.502710 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d8ec5429-dc99-4e10-81f7-20ef7747817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.512832 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 783/1546] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.514103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168b102-71f7-4ef1-ace6-4ca1de792e37 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.514628 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168b102-71f7-4ef1-ace6-4ca1de792e37 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.515125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168b102-71f7-4ef1-ace6-4ca1de792e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.535158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7168b102-71f7-4ef1-ace6-4ca1de792e37 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.536678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7168b102-71f7-4ef1-ace6-4ca1de792e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.544830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 784/1547] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.546013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502495c-f2ef-41ea-a15a-de5de7399f84 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.546324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502495c-f2ef-41ea-a15a-de5de7399f84 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.546595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502495c-f2ef-41ea-a15a-de5de7399f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.566034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a502495c-f2ef-41ea-a15a-de5de7399f84 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.567152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a502495c-f2ef-41ea-a15a-de5de7399f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.575848 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 785/1548] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.577015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcec1d-dd36-431f-8a7f-8a665c1c5ded None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.577303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcec1d-dd36-431f-8a7f-8a665c1c5ded None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.577577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcec1d-dd36-431f-8a7f-8a665c1c5ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.583606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 764/1549] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:04.585122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab3450-2b23-4fd7-82c3-872be1542601 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.585696 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab3450-2b23-4fd7-82c3-872be1542601 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.585975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab3450-2b23-4fd7-82c3-872be1542601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.597518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-31dcec1d-dd36-431f-8a7f-8a665c1c5ded None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.598846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-31dcec1d-dd36-431f-8a7f-8a665c1c5ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.606178 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a5ab3450-2b23-4fd7-82c3-872be1542601 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.607388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a5ab3450-2b23-4fd7-82c3-872be1542601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.607525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 786/1550] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.608243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcec1d-dd36-431f-8a7f-8a665c1c5ded None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.618913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 765/1551] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.620173 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcde27-7d6b-4159-8023-ab4e7bc3e6b9 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.620451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcde27-7d6b-4159-8023-ab4e7bc3e6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.620734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcde27-7d6b-4159-8023-ab4e7bc3e6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.625624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcec1d-dd36-431f-8a7f-8a665c1c5ded None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.630303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32795ec-b400-4335-850a-8206586ed598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.630915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32795ec-b400-4335-850a-8206586ed598 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.631195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32795ec-b400-4335-850a-8206586ed598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.631469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32795ec-b400-4335-850a-8206586ed598 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.632110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32795ec-b400-4335-850a-8206586ed598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:04.632965 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32795ec-b400-4335-850a-8206586ed598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.634433 dv-cinder-850836-6-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-e32795ec-b400-4335-850a-8206586ed598 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:47:04.634433 dv-cinder-850836-6-smb devstack@keystone.service[81819]: warnings.warn(msg) Aug 22 12:47:04.634433 dv-cinder-850836-6-smb devstack@keystone.service[81819]: Aug 22 12:47:04.636164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32795ec-b400-4335-850a-8206586ed598 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.641427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-f1bcde27-7d6b-4159-8023-ab4e7bc3e6b9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.642666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f1bcde27-7d6b-4159-8023-ab4e7bc3e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.646845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 787/1552] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:04.648212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625539d4-c82d-4638-a098-3067d9583bc5 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.648632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625539d4-c82d-4638-a098-3067d9583bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.649037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625539d4-c82d-4638-a098-3067d9583bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.651018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 766/1553] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.652179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd677a-f0b6-42c1-8cf9-8a943cf91a75 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.652467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd677a-f0b6-42c1-8cf9-8a943cf91a75 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.652736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd677a-f0b6-42c1-8cf9-8a943cf91a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.673343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5bbd677a-f0b6-42c1-8cf9-8a943cf91a75 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.673592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-625539d4-c82d-4638-a098-3067d9583bc5 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.674651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-625539d4-c82d-4638-a098-3067d9583bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.674851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5bbd677a-f0b6-42c1-8cf9-8a943cf91a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.683318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 788/1554] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.686345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 767/1555] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.686466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625539d4-c82d-4638-a098-3067d9583bc5 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.686576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81f21a-423e-4959-8bc2-42949837d7ba None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.686710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81f21a-423e-4959-8bc2-42949837d7ba None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.686981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81f21a-423e-4959-8bc2-42949837d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.700589 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625539d4-c82d-4638-a098-3067d9583bc5 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.705852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cd86b-3adb-4352-a680-6f770bca7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.706417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cd86b-3adb-4352-a680-6f770bca7e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.706708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cd86b-3adb-4352-a680-6f770bca7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.706985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cd86b-3adb-4352-a680-6f770bca7e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.707604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6c81f21a-423e-4959-8bc2-42949837d7ba None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.707745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cd86b-3adb-4352-a680-6f770bca7e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.708819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6c81f21a-423e-4959-8bc2-42949837d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.709376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cd86b-3adb-4352-a680-6f770bca7e40 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.717826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 768/1556] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.723181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 789/1557] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:04.723181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cd86b-3adb-4352-a680-6f770bca7e40 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.723441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4178c32-2959-4ca0-ad79-caba2a6bb095 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.723441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4178c32-2959-4ca0-ad79-caba2a6bb095 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.723441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4178c32-2959-4ca0-ad79-caba2a6bb095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.731663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cd86b-3adb-4352-a680-6f770bca7e40 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.736242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b2875-09cc-4291-82ff-ca0c8849dcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.736856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b2875-09cc-4291-82ff-ca0c8849dcfc admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.737138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b2875-09cc-4291-82ff-ca0c8849dcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.737413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b2875-09cc-4291-82ff-ca0c8849dcfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.738052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b2875-09cc-4291-82ff-ca0c8849dcfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:04.738397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b2875-09cc-4291-82ff-ca0c8849dcfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.740032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b2875-09cc-4291-82ff-ca0c8849dcfc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.742468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-d4178c32-2959-4ca0-ad79-caba2a6bb095 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.743648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d4178c32-2959-4ca0-ad79-caba2a6bb095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.751432 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 769/1558] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.752250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4178c32-2959-4ca0-ad79-caba2a6bb095 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.753565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 790/1559] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:04.754677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab9cf4-f1fd-4f9b-a3b9-8ba923e01d09 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.755167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab9cf4-f1fd-4f9b-a3b9-8ba923e01d09 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.755296 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab9cf4-f1fd-4f9b-a3b9-8ba923e01d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.765007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4178c32-2959-4ca0-ad79-caba2a6bb095 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.769960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27659b-c9cd-4083-bd17-7975cd14a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.770600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27659b-c9cd-4083-bd17-7975cd14a12c admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.770882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27659b-c9cd-4083-bd17-7975cd14a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.771157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27659b-c9cd-4083-bd17-7975cd14a12c admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.771872 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27659b-c9cd-4083-bd17-7975cd14a12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.772891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WARNING py.warnings [None req-8c27659b-c9cd-4083-bd17-7975cd14a12c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:47:04.772891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: warnings.warn(msg) Aug 22 12:47:04.772891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: Aug 22 12:47:04.774911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27659b-c9cd-4083-bd17-7975cd14a12c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.775731 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d8ab9cf4-f1fd-4f9b-a3b9-8ba923e01d09 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.776921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d8ab9cf4-f1fd-4f9b-a3b9-8ba923e01d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.784995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 791/1560] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.788730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab9cf4-f1fd-4f9b-a3b9-8ba923e01d09 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.795465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab9cf4-f1fd-4f9b-a3b9-8ba923e01d09 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.800166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0834-452a-44b1-93b9-8e8d8c89294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.802634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0834-452a-44b1-93b9-8e8d8c89294a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.802634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0834-452a-44b1-93b9-8e8d8c89294a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.802634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0834-452a-44b1-93b9-8e8d8c89294a admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.802634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0834-452a-44b1-93b9-8e8d8c89294a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:04.802634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0834-452a-44b1-93b9-8e8d8c89294a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.804083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0834-452a-44b1-93b9-8e8d8c89294a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.815807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 792/1561] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:04.817020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8005505-79e1-49bc-9da4-f8f2b456ebb0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.817258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8005505-79e1-49bc-9da4-f8f2b456ebb0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.817543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8005505-79e1-49bc-9da4-f8f2b456ebb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.837470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a8005505-79e1-49bc-9da4-f8f2b456ebb0 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.838705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a8005505-79e1-49bc-9da4-f8f2b456ebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.846696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 793/1562] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.847462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8005505-79e1-49bc-9da4-f8f2b456ebb0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.857110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8005505-79e1-49bc-9da4-f8f2b456ebb0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.860636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 770/1563] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:04.861402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27659b-c9cd-4083-bd17-7975cd14a12c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.861751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd82696-b005-49c7-a8ad-747937c74c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.862358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82696-b005-49c7-a8ad-747937c74c03 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.865926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82696-b005-49c7-a8ad-747937c74c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.865926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82696-b005-49c7-a8ad-747937c74c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.865926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd82696-b005-49c7-a8ad-747937c74c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:04.865926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd82696-b005-49c7-a8ad-747937c74c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.865926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd82696-b005-49c7-a8ad-747937c74c03 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.885838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 794/1564] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:04.885838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd82696-b005-49c7-a8ad-747937c74c03 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.888806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd82696-b005-49c7-a8ad-747937c74c03 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.892500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:04.931964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27659b-c9cd-4083-bd17-7975cd14a12c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.936788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14dec-73d9-4528-ba5e-617e035b9ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.937398 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14dec-73d9-4528-ba5e-617e035b9ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.937677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14dec-73d9-4528-ba5e-617e035b9ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.937956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14dec-73d9-4528-ba5e-617e035b9ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.938639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef14dec-73d9-4528-ba5e-617e035b9ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.940235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef14dec-73d9-4528-ba5e-617e035b9ba4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.946464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726b21a-6713-4400-bcb0-4ee50b79e1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.947083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726b21a-6713-4400-bcb0-4ee50b79e1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.947394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726b21a-6713-4400-bcb0-4ee50b79e1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.947674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726b21a-6713-4400-bcb0-4ee50b79e1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.948316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726b21a-6713-4400-bcb0-4ee50b79e1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:04.948894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726b21a-6713-4400-bcb0-4ee50b79e1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.950636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726b21a-6713-4400-bcb0-4ee50b79e1d0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.951033 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 771/1565] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:04.951738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14dec-73d9-4528-ba5e-617e035b9ba4 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.961902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14dec-73d9-4528-ba5e-617e035b9ba4 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.966522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faab47-7bb9-47d1-915c-7dc3beabc8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.973581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 795/1566] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:04.973750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faab47-7bb9-47d1-915c-7dc3beabc8ab admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.973838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726b21a-6713-4400-bcb0-4ee50b79e1d0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.973935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faab47-7bb9-47d1-915c-7dc3beabc8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.973935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faab47-7bb9-47d1-915c-7dc3beabc8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.973935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faab47-7bb9-47d1-915c-7dc3beabc8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.973935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faab47-7bb9-47d1-915c-7dc3beabc8ab admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.978788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726b21a-6713-4400-bcb0-4ee50b79e1d0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.981011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:04.984197 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d60b6-ffae-47c7-ae42-cf02a69bb113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.984814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d60b6-ffae-47c7-ae42-cf02a69bb113 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.985096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d60b6-ffae-47c7-ae42-cf02a69bb113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.985373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d60b6-ffae-47c7-ae42-cf02a69bb113 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.986011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d60b6-ffae-47c7-ae42-cf02a69bb113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:04.986349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d60b6-ffae-47c7-ae42-cf02a69bb113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.987953 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d60b6-ffae-47c7-ae42-cf02a69bb113 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.999709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 796/1567] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:05.000697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d60b6-ffae-47c7-ae42-cf02a69bb113 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.011354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d60b6-ffae-47c7-ae42-cf02a69bb113 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.016978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099a7d6-01bf-458b-84ce-d6eac9f407a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.017595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099a7d6-01bf-458b-84ce-d6eac9f407a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.017878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099a7d6-01bf-458b-84ce-d6eac9f407a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.018150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099a7d6-01bf-458b-84ce-d6eac9f407a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.023067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099a7d6-01bf-458b-84ce-d6eac9f407a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.023067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099a7d6-01bf-458b-84ce-d6eac9f407a9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.055110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 772/1568] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:05.057054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faab47-7bb9-47d1-915c-7dc3beabc8ab admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.116496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faab47-7bb9-47d1-915c-7dc3beabc8ab admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.121686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c304b1-066f-4c80-80aa-42996f2c6611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.122321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c304b1-066f-4c80-80aa-42996f2c6611 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.122608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c304b1-066f-4c80-80aa-42996f2c6611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.122886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c304b1-066f-4c80-80aa-42996f2c6611 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.123523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c304b1-066f-4c80-80aa-42996f2c6611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:05.123832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c304b1-066f-4c80-80aa-42996f2c6611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.125422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c304b1-066f-4c80-80aa-42996f2c6611 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.137055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 773/1569] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:05.160125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c304b1-066f-4c80-80aa-42996f2c6611 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.160125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c304b1-066f-4c80-80aa-42996f2c6611 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.160125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d551b-3cb9-4bd1-b45f-10051559c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.160125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d551b-3cb9-4bd1-b45f-10051559c32a admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.160542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d551b-3cb9-4bd1-b45f-10051559c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.160542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d551b-3cb9-4bd1-b45f-10051559c32a admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.160542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d551b-3cb9-4bd1-b45f-10051559c32a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.160542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d551b-3cb9-4bd1-b45f-10051559c32a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.203552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 797/1570] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:05.204518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099a7d6-01bf-458b-84ce-d6eac9f407a9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.267465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099a7d6-01bf-458b-84ce-d6eac9f407a9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.272045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ca3c-4a45-4411-8b5a-06bf302fef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.272654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ca3c-4a45-4411-8b5a-06bf302fef28 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.273483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ca3c-4a45-4411-8b5a-06bf302fef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.273808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ca3c-4a45-4411-8b5a-06bf302fef28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.274607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ca3c-4a45-4411-8b5a-06bf302fef28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.276525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ca3c-4a45-4411-8b5a-06bf302fef28 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.297402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 774/1571] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:05.297402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d551b-3cb9-4bd1-b45f-10051559c32a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.307768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d551b-3cb9-4bd1-b45f-10051559c32a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.312753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403922d8-0688-4df6-a9bc-1e00e4f4578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.313640 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403922d8-0688-4df6-a9bc-1e00e4f4578b admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.313789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403922d8-0688-4df6-a9bc-1e00e4f4578b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.313955 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403922d8-0688-4df6-a9bc-1e00e4f4578b admin admin] PATH_INFO: `/v3/projects/425a68e8750a4c9b8b1ce76c761010ca/users/a35e0c8f7cb749de8dab38796c029bf0/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.329345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403922d8-0688-4df6-a9bc-1e00e4f4578b admin admin] RBAC: Authorizing `identity:create_grant(project_id=425a68e8750a4c9b8b1ce76c761010ca, user_id=a35e0c8f7cb749de8dab38796c029bf0, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.330676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WARNING py.warnings [None req-403922d8-0688-4df6-a9bc-1e00e4f4578b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:47:05.330676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: warnings.warn(msg) Aug 22 12:47:05.330676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: Aug 22 12:47:05.332609 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403922d8-0688-4df6-a9bc-1e00e4f4578b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.386855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 798/1572] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:05.387614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ca3c-4a45-4411-8b5a-06bf302fef28 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.414252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 775/1573] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:05 2022] PUT /identity/v3/projects/425a68e8750a4c9b8b1ce76c761010ca/users/a35e0c8f7cb749de8dab38796c029bf0/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:05.416456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403922d8-0688-4df6-a9bc-1e00e4f4578b admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.440062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:05.451412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ca3c-4a45-4411-8b5a-06bf302fef28 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.481265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403922d8-0688-4df6-a9bc-1e00e4f4578b admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.486150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd5f1-c359-4078-ad97-e3f6cd528144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.490961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd5f1-c359-4078-ad97-e3f6cd528144 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.490961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd5f1-c359-4078-ad97-e3f6cd528144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.490961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd5f1-c359-4078-ad97-e3f6cd528144 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.490961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bd5f1-c359-4078-ad97-e3f6cd528144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.490961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bd5f1-c359-4078-ad97-e3f6cd528144 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.510563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58fb6a-243a-45eb-a9d0-bee24a26ccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.511182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58fb6a-243a-45eb-a9d0-bee24a26ccba admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.511454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58fb6a-243a-45eb-a9d0-bee24a26ccba admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.511728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58fb6a-243a-45eb-a9d0-bee24a26ccba admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.512348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58fb6a-243a-45eb-a9d0-bee24a26ccba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.514367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58fb6a-243a-45eb-a9d0-bee24a26ccba admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.586825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 776/1574] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:05.587642 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd5f1-c359-4078-ad97-e3f6cd528144 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.619546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:05.654470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd5f1-c359-4078-ad97-e3f6cd528144 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.659119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b03676-a4e4-49ff-807f-b27da37beade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.659731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b03676-a4e4-49ff-807f-b27da37beade admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.660053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b03676-a4e4-49ff-807f-b27da37beade admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.660442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b03676-a4e4-49ff-807f-b27da37beade admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.661066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b03676-a4e4-49ff-807f-b27da37beade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.663046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b03676-a4e4-49ff-807f-b27da37beade admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.727381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 799/1575] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/projects => generated 393 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:05.727381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58fb6a-243a-45eb-a9d0-bee24a26ccba admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.753841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 777/1576] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/users => generated 282 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:05.753841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b03676-a4e4-49ff-807f-b27da37beade admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.762809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b03676-a4e4-49ff-807f-b27da37beade admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.787830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58fb6a-243a-45eb-a9d0-bee24a26ccba admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.793096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccb66b-1060-4430-81b4-6b2e45182d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.793714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb66b-1060-4430-81b4-6b2e45182d51 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.794000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb66b-1060-4430-81b4-6b2e45182d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.794301 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb66b-1060-4430-81b4-6b2e45182d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.794937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccb66b-1060-4430-81b4-6b2e45182d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.796876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccb66b-1060-4430-81b4-6b2e45182d51 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.819073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c698-a262-4dd1-8f48-7fab269e67d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.819791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c698-a262-4dd1-8f48-7fab269e67d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.820360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c698-a262-4dd1-8f48-7fab269e67d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.820775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c698-a262-4dd1-8f48-7fab269e67d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.821500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521c698-a262-4dd1-8f48-7fab269e67d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.823564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521c698-a262-4dd1-8f48-7fab269e67d8 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.906933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 800/1577] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:05.907687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccb66b-1060-4430-81b4-6b2e45182d51 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.942054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 778/1578] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:05.942054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c698-a262-4dd1-8f48-7fab269e67d8 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.950205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c698-a262-4dd1-8f48-7fab269e67d8 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.971628 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccb66b-1060-4430-81b4-6b2e45182d51 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.977006 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e3c35-7155-48ab-bd95-66b70566db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.977681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3c35-7155-48ab-bd95-66b70566db86 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.977966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3c35-7155-48ab-bd95-66b70566db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.978294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3c35-7155-48ab-bd95-66b70566db86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.978923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e3c35-7155-48ab-bd95-66b70566db86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.980549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e3c35-7155-48ab-bd95-66b70566db86 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.990482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 801/1579] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:05.991802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c74c5d-9fd5-4af7-b5b5-240eccad7223 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.992093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c74c5d-9fd5-4af7-b5b5-240eccad7223 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.992377 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c74c5d-9fd5-4af7-b5b5-240eccad7223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.000605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:06.009010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c69c66-6f0e-4f16-a1d2-bd48b2c06f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.009677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c69c66-6f0e-4f16-a1d2-bd48b2c06f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.009943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c69c66-6f0e-4f16-a1d2-bd48b2c06f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.010236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c69c66-6f0e-4f16-a1d2-bd48b2c06f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.010859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c69c66-6f0e-4f16-a1d2-bd48b2c06f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.012768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c69c66-6f0e-4f16-a1d2-bd48b2c06f5e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.012893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d1c74c5d-9fd5-4af7-b5b5-240eccad7223 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:06.014135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d1c74c5d-9fd5-4af7-b5b5-240eccad7223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:06.021637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 802/1580] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:06.022493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c74c5d-9fd5-4af7-b5b5-240eccad7223 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.032456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c74c5d-9fd5-4af7-b5b5-240eccad7223 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.038207 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb1580-789a-4c1d-8e57-88c47514de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.039085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb1580-789a-4c1d-8e57-88c47514de41 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.039452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb1580-789a-4c1d-8e57-88c47514de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.039736 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb1580-789a-4c1d-8e57-88c47514de41 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.040361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb1580-789a-4c1d-8e57-88c47514de41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.041434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-fdcb1580-789a-4c1d-8e57-88c47514de41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:47:06.041434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: warnings.warn(msg) Aug 22 12:47:06.041434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: Aug 22 12:47:06.042677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb1580-789a-4c1d-8e57-88c47514de41 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.108119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 779/1581] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:06.108119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c69c66-6f0e-4f16-a1d2-bd48b2c06f5e admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.115493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c69c66-6f0e-4f16-a1d2-bd48b2c06f5e admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.120825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bacd3f-eac4-4ec0-a66a-fc20b1900980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.121406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bacd3f-eac4-4ec0-a66a-fc20b1900980 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.121690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bacd3f-eac4-4ec0-a66a-fc20b1900980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.121968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bacd3f-eac4-4ec0-a66a-fc20b1900980 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.122620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bacd3f-eac4-4ec0-a66a-fc20b1900980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.124542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bacd3f-eac4-4ec0-a66a-fc20b1900980 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.134534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 803/1582] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:06 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:06.135620 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb1580-789a-4c1d-8e57-88c47514de41 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.145749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb1580-789a-4c1d-8e57-88c47514de41 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.150778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9ebb0-9d02-4258-ba3c-6b7b150e66b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.151380 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9ebb0-9d02-4258-ba3c-6b7b150e66b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.151664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9ebb0-9d02-4258-ba3c-6b7b150e66b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.151940 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9ebb0-9d02-4258-ba3c-6b7b150e66b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.152643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9ebb0-9d02-4258-ba3c-6b7b150e66b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.154291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9ebb0-9d02-4258-ba3c-6b7b150e66b8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.170688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 804/1583] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.170688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9ebb0-9d02-4258-ba3c-6b7b150e66b8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.176505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9ebb0-9d02-4258-ba3c-6b7b150e66b8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.181814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d644aa-1f57-49fc-b6aa-d674c1edb6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.182460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d644aa-1f57-49fc-b6aa-d674c1edb6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.182745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d644aa-1f57-49fc-b6aa-d674c1edb6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.183020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d644aa-1f57-49fc-b6aa-d674c1edb6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.183646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d644aa-1f57-49fc-b6aa-d674c1edb6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.185632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d644aa-1f57-49fc-b6aa-d674c1edb6c9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.231481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 780/1584] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:06 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:06.232446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bacd3f-eac4-4ec0-a66a-fc20b1900980 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.242954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bacd3f-eac4-4ec0-a66a-fc20b1900980 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.247663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33087dac-d28c-40d2-acb5-99713026d105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.248261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33087dac-d28c-40d2-acb5-99713026d105 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.248549 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33087dac-d28c-40d2-acb5-99713026d105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.248829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33087dac-d28c-40d2-acb5-99713026d105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.249460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33087dac-d28c-40d2-acb5-99713026d105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.251119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33087dac-d28c-40d2-acb5-99713026d105 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.263246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 781/1585] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.264166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33087dac-d28c-40d2-acb5-99713026d105 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.274075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33087dac-d28c-40d2-acb5-99713026d105 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.279624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209249ae-3070-4b6b-8e50-a73a97a1a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.284140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209249ae-3070-4b6b-8e50-a73a97a1a108 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.284140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209249ae-3070-4b6b-8e50-a73a97a1a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.284140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209249ae-3070-4b6b-8e50-a73a97a1a108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.284140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209249ae-3070-4b6b-8e50-a73a97a1a108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.284595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 805/1586] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:06 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:06.285037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209249ae-3070-4b6b-8e50-a73a97a1a108 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.285139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d644aa-1f57-49fc-b6aa-d674c1edb6c9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.285235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:06.296660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 782/1587] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.297485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209249ae-3070-4b6b-8e50-a73a97a1a108 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.309070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209249ae-3070-4b6b-8e50-a73a97a1a108 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.314842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d6b3-83fc-497b-82d4-8f6725dcff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.315454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d6b3-83fc-497b-82d4-8f6725dcff4e admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.315787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d6b3-83fc-497b-82d4-8f6725dcff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.316066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d6b3-83fc-497b-82d4-8f6725dcff4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.316701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d6b3-83fc-497b-82d4-8f6725dcff4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.318359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d6b3-83fc-497b-82d4-8f6725dcff4e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.329491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 783/1588] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.330713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d6b3-83fc-497b-82d4-8f6725dcff4e admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.340567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d6b3-83fc-497b-82d4-8f6725dcff4e admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.344538 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d644aa-1f57-49fc-b6aa-d674c1edb6c9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.345380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee25a23-4dbc-4764-8c86-5d1d46124d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.345979 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee25a23-4dbc-4764-8c86-5d1d46124d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.346293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee25a23-4dbc-4764-8c86-5d1d46124d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.346573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee25a23-4dbc-4764-8c86-5d1d46124d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.347216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee25a23-4dbc-4764-8c86-5d1d46124d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.348441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff0693-bcd3-4e17-873b-d058f168e878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.348795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee25a23-4dbc-4764-8c86-5d1d46124d2b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.349117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff0693-bcd3-4e17-873b-d058f168e878 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.349403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff0693-bcd3-4e17-873b-d058f168e878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.349682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff0693-bcd3-4e17-873b-d058f168e878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.359636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff0693-bcd3-4e17-873b-d058f168e878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.359930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 784/1589] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.360763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee25a23-4dbc-4764-8c86-5d1d46124d2b admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.361441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff0693-bcd3-4e17-873b-d058f168e878 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.371626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 806/1590] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:06.372530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff0693-bcd3-4e17-873b-d058f168e878 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.372892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee25a23-4dbc-4764-8c86-5d1d46124d2b admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.377484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d0d9-30e1-4490-a8f9-3e7fb0214cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.378088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d0d9-30e1-4490-a8f9-3e7fb0214cda admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.378488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d0d9-30e1-4490-a8f9-3e7fb0214cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.378771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d0d9-30e1-4490-a8f9-3e7fb0214cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.379409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1d0d9-30e1-4490-a8f9-3e7fb0214cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.381018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1d0d9-30e1-4490-a8f9-3e7fb0214cda admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.383155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff0693-bcd3-4e17-873b-d058f168e878 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.388654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c92b90-2b77-4c90-84f2-ac03b6fb6b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.389000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c92b90-2b77-4c90-84f2-ac03b6fb6b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.389249 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c92b90-2b77-4c90-84f2-ac03b6fb6b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.389526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c92b90-2b77-4c90-84f2-ac03b6fb6b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.390176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c92b90-2b77-4c90-84f2-ac03b6fb6b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.391818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c92b90-2b77-4c90-84f2-ac03b6fb6b83 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.403871 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 807/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.404711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c92b90-2b77-4c90-84f2-ac03b6fb6b83 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.408932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 785/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.408932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d0d9-30e1-4490-a8f9-3e7fb0214cda admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.415650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c92b90-2b77-4c90-84f2-ac03b6fb6b83 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.417449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d0d9-30e1-4490-a8f9-3e7fb0214cda admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.420228 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4cb53-ecfd-4226-ab01-b65f2e47d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.420898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4cb53-ecfd-4226-ab01-b65f2e47d565 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.421109 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4cb53-ecfd-4226-ab01-b65f2e47d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.421383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4cb53-ecfd-4226-ab01-b65f2e47d565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.422016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4cb53-ecfd-4226-ab01-b65f2e47d565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.422154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff54f-e360-4de7-93cd-ebf4c422eabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.422702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff54f-e360-4de7-93cd-ebf4c422eabd admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.422988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff54f-e360-4de7-93cd-ebf4c422eabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.423432 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff54f-e360-4de7-93cd-ebf4c422eabd admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.423750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4cb53-ecfd-4226-ab01-b65f2e47d565 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.423897 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedff54f-e360-4de7-93cd-ebf4c422eabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.425929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedff54f-e360-4de7-93cd-ebf4c422eabd admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.433789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 808/1593] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.434694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4cb53-ecfd-4226-ab01-b65f2e47d565 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.439400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 786/1594] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.439400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff54f-e360-4de7-93cd-ebf4c422eabd admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.444527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4cb53-ecfd-4226-ab01-b65f2e47d565 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.449130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff54f-e360-4de7-93cd-ebf4c422eabd admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.449535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83cce1-7e38-482c-a79f-5a0eec009dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.451950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83cce1-7e38-482c-a79f-5a0eec009dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.451950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83cce1-7e38-482c-a79f-5a0eec009dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.451950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83cce1-7e38-482c-a79f-5a0eec009dd1 admin admin] PATH_INFO: `/v3/projects/012dceb950a2419ab122e8cba66095fa/users/4489cb4f8ec144468b8308ba0a809539/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.454011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f7ea1-a19b-4e42-9cc3-6b4bbd6279d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.455799 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f7ea1-a19b-4e42-9cc3-6b4bbd6279d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.456084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f7ea1-a19b-4e42-9cc3-6b4bbd6279d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.456360 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f7ea1-a19b-4e42-9cc3-6b4bbd6279d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.457019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f7ea1-a19b-4e42-9cc3-6b4bbd6279d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.458778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f7ea1-a19b-4e42-9cc3-6b4bbd6279d9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.466929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83cce1-7e38-482c-a79f-5a0eec009dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012dceb950a2419ab122e8cba66095fa, user_id=4489cb4f8ec144468b8308ba0a809539, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.469650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83cce1-7e38-482c-a79f-5a0eec009dd1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.475586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 787/1595] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.475586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f7ea1-a19b-4e42-9cc3-6b4bbd6279d9 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.485039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f7ea1-a19b-4e42-9cc3-6b4bbd6279d9 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.489950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd21cdf-7061-49f5-9591-7a92a62c7d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.490618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd21cdf-7061-49f5-9591-7a92a62c7d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.490906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd21cdf-7061-49f5-9591-7a92a62c7d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.491181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd21cdf-7061-49f5-9591-7a92a62c7d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.492553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd21cdf-7061-49f5-9591-7a92a62c7d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.494138 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd21cdf-7061-49f5-9591-7a92a62c7d3d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.504495 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 788/1596] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.509284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd21cdf-7061-49f5-9591-7a92a62c7d3d admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.514902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd21cdf-7061-49f5-9591-7a92a62c7d3d admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.519855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbe236-700a-42db-9901-c7ee3e7fb52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.520481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbe236-700a-42db-9901-c7ee3e7fb52c admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.520755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbe236-700a-42db-9901-c7ee3e7fb52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.521025 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbe236-700a-42db-9901-c7ee3e7fb52c admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.521657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbe236-700a-42db-9901-c7ee3e7fb52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.523451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbe236-700a-42db-9901-c7ee3e7fb52c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.533206 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 789/1597] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.545078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbe236-700a-42db-9901-c7ee3e7fb52c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.545078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbe236-700a-42db-9901-c7ee3e7fb52c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.549561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa6e60-991b-4ce8-bdaa-30f3f9ddbc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.550221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa6e60-991b-4ce8-bdaa-30f3f9ddbc5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.550529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa6e60-991b-4ce8-bdaa-30f3f9ddbc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.550805 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa6e60-991b-4ce8-bdaa-30f3f9ddbc5f admin admin] PATH_INFO: `/v3/projects/1c9877ed18184aad9d9da95c7e0103cf/users/32a2c2ce197446289c04086e766f1bbb/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.577535 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa6e60-991b-4ce8-bdaa-30f3f9ddbc5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9877ed18184aad9d9da95c7e0103cf, user_id=32a2c2ce197446289c04086e766f1bbb, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.577696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 809/1598] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:06 2022] PUT /identity/v3/projects/012dceb950a2419ab122e8cba66095fa/users/4489cb4f8ec144468b8308ba0a809539/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:06.577696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83cce1-7e38-482c-a79f-5a0eec009dd1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.577893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa6e60-991b-4ce8-bdaa-30f3f9ddbc5f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.631727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83cce1-7e38-482c-a79f-5a0eec009dd1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.636440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbdf82-b62e-43b4-abca-e1ce35447be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.637090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbdf82-b62e-43b4-abca-e1ce35447be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.637373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbdf82-b62e-43b4-abca-e1ce35447be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.637642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbdf82-b62e-43b4-abca-e1ce35447be3 admin admin] PATH_INFO: `/v3/projects/572855546ca54e1793a3fbd419e38d19/users/1279a39542b54796a00665928bb57e9c/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.649998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:06.653171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbdf82-b62e-43b4-abca-e1ce35447be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572855546ca54e1793a3fbd419e38d19, user_id=1279a39542b54796a00665928bb57e9c, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.655857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbdf82-b62e-43b4-abca-e1ce35447be3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.687679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 790/1599] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:06 2022] PUT /identity/v3/projects/1c9877ed18184aad9d9da95c7e0103cf/users/32a2c2ce197446289c04086e766f1bbb/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:06.698783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa6e60-991b-4ce8-bdaa-30f3f9ddbc5f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.761072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa6e60-991b-4ce8-bdaa-30f3f9ddbc5f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.765741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3b828-90ed-4a20-8375-50b8f6950842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.766466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3b828-90ed-4a20-8375-50b8f6950842 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.766759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3b828-90ed-4a20-8375-50b8f6950842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.767032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3b828-90ed-4a20-8375-50b8f6950842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.767682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3b828-90ed-4a20-8375-50b8f6950842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.769292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3b828-90ed-4a20-8375-50b8f6950842 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.779860 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 810/1600] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:06 2022] PUT /identity/v3/projects/572855546ca54e1793a3fbd419e38d19/users/1279a39542b54796a00665928bb57e9c/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:06.782320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbdf82-b62e-43b4-abca-e1ce35447be3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.782428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 791/1601] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:06.782428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3b828-90ed-4a20-8375-50b8f6950842 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.792687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3b828-90ed-4a20-8375-50b8f6950842 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.842103 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:06.846688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbdf82-b62e-43b4-abca-e1ce35447be3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.851969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbe649-e412-458a-bbab-3579907d248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.852763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e6ed9-d877-499d-9dfe-041ea3d6ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.853461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e6ed9-d877-499d-9dfe-041ea3d6ced9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.853743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e6ed9-d877-499d-9dfe-041ea3d6ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.854022 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e6ed9-d877-499d-9dfe-041ea3d6ced9 admin admin] PATH_INFO: `/v3/projects/1587a1b0dd0d4284afdd6384fe725ef0/users/6e5963aeb4514b80a3d786da8a05da0c/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.854842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe649-e412-458a-bbab-3579907d248c admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.855132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe649-e412-458a-bbab-3579907d248c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.855414 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe649-e412-458a-bbab-3579907d248c admin admin] PATH_INFO: `/v3/projects/32194c49d249450496ccd0aaf317d9fb/users/a26f0791dd7741ae8ff4065dc43f099e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.872956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbe649-e412-458a-bbab-3579907d248c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32194c49d249450496ccd0aaf317d9fb, user_id=a26f0791dd7741ae8ff4065dc43f099e, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.873168 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e6ed9-d877-499d-9dfe-041ea3d6ced9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1587a1b0dd0d4284afdd6384fe725ef0, user_id=6e5963aeb4514b80a3d786da8a05da0c, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.875806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbe649-e412-458a-bbab-3579907d248c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.875925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e6ed9-d877-499d-9dfe-041ea3d6ced9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.971643 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 792/1602] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:06 2022] PUT /identity/v3/projects/1587a1b0dd0d4284afdd6384fe725ef0/users/6e5963aeb4514b80a3d786da8a05da0c/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:06.972750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e6ed9-d877-499d-9dfe-041ea3d6ced9 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.978696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 811/1603] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:06 2022] PUT /identity/v3/projects/32194c49d249450496ccd0aaf317d9fb/users/a26f0791dd7741ae8ff4065dc43f099e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:06.978696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71907353-19c0-47fb-ad9f-c507b73a321a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.978696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71907353-19c0-47fb-ad9f-c507b73a321a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.978696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71907353-19c0-47fb-ad9f-c507b73a321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.003932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-71907353-19c0-47fb-ad9f-c507b73a321a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:07.005469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-71907353-19c0-47fb-ad9f-c507b73a321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.055925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e6ed9-d877-499d-9dfe-041ea3d6ced9 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.060978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447de0f-4942-4a20-998d-e20e9ecb285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.061628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447de0f-4942-4a20-998d-e20e9ecb285a admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.061909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447de0f-4942-4a20-998d-e20e9ecb285a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.062201 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447de0f-4942-4a20-998d-e20e9ecb285a admin admin] PATH_INFO: `/v3/projects/1614488b49c545beb824033e1ef56155/users/23cfeac2a23e4f82a2d515db5c46ab6e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.067156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 812/1604] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:07.070629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fb17d-3c52-4449-8bf4-148a3a6fa7cc None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.070629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fb17d-3c52-4449-8bf4-148a3a6fa7cc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.070629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fb17d-3c52-4449-8bf4-148a3a6fa7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.079249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447de0f-4942-4a20-998d-e20e9ecb285a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614488b49c545beb824033e1ef56155, user_id=23cfeac2a23e4f82a2d515db5c46ab6e, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.084182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447de0f-4942-4a20-998d-e20e9ecb285a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.097300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a01fb17d-3c52-4449-8bf4-148a3a6fa7cc None None] MFA Rules not processed for user `32a2c2ce197446289c04086e766f1bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:07.098550 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a01fb17d-3c52-4449-8bf4-148a3a6fa7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.154253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 793/1605] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:06 2022] PUT /identity/v3/projects/1614488b49c545beb824033e1ef56155/users/23cfeac2a23e4f82a2d515db5c46ab6e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:07.154253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447de0f-4942-4a20-998d-e20e9ecb285a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.171062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 813/1606] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:07.176823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db278d8-3b71-40c9-9b3d-6224321ad1cc None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.176823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db278d8-3b71-40c9-9b3d-6224321ad1cc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.176823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db278d8-3b71-40c9-9b3d-6224321ad1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.185176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:07.210790 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4db278d8-3b71-40c9-9b3d-6224321ad1cc None None] MFA Rules not processed for user `1279a39542b54796a00665928bb57e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:07.210790 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4db278d8-3b71-40c9-9b3d-6224321ad1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.238009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447de0f-4942-4a20-998d-e20e9ecb285a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.243645 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432abaef-3539-403e-9357-4cbcff49db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.244436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432abaef-3539-403e-9357-4cbcff49db86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.244720 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432abaef-3539-403e-9357-4cbcff49db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.245000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432abaef-3539-403e-9357-4cbcff49db86 admin admin] PATH_INFO: `/v3/projects/5c59a476bb484d59b29e4f9d98ba544e/users/b9615b91b52d47ba822426dd3b343e1f/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.260424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432abaef-3539-403e-9357-4cbcff49db86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c59a476bb484d59b29e4f9d98ba544e, user_id=b9615b91b52d47ba822426dd3b343e1f, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.263172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432abaef-3539-403e-9357-4cbcff49db86 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.279695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 814/1607] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:07.281090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254202e9-8136-4349-a8bd-6309b74f93ac None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.281403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254202e9-8136-4349-a8bd-6309b74f93ac None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.281792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254202e9-8136-4349-a8bd-6309b74f93ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.301263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-254202e9-8136-4349-a8bd-6309b74f93ac None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:07.302491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-254202e9-8136-4349-a8bd-6309b74f93ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.310272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 815/1608] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:07.311733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8e28b-a3ac-41a9-99f0-93b29ada8011 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.312021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8e28b-a3ac-41a9-99f0-93b29ada8011 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.312295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8e28b-a3ac-41a9-99f0-93b29ada8011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.332474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-01d8e28b-a3ac-41a9-99f0-93b29ada8011 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:07.333659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-01d8e28b-a3ac-41a9-99f0-93b29ada8011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.341685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 816/1609] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:07.342548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8e28b-a3ac-41a9-99f0-93b29ada8011 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.351974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 794/1610] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:07 2022] PUT /identity/v3/projects/5c59a476bb484d59b29e4f9d98ba544e/users/b9615b91b52d47ba822426dd3b343e1f/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:07.353400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829815e-6e1b-4618-a355-0686544a4b06 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.354371 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829815e-6e1b-4618-a355-0686544a4b06 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.354371 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829815e-6e1b-4618-a355-0686544a4b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.377161 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-8829815e-6e1b-4618-a355-0686544a4b06 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:07.378433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8829815e-6e1b-4618-a355-0686544a4b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.415269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8e28b-a3ac-41a9-99f0-93b29ada8011 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.417418 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:07.446019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 795/1611] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:07.446938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829815e-6e1b-4618-a355-0686544a4b06 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.457910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829815e-6e1b-4618-a355-0686544a4b06 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.463390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c294d-1689-43d4-949e-cdd29cdacadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.464082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c294d-1689-43d4-949e-cdd29cdacadd admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.464325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c294d-1689-43d4-949e-cdd29cdacadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.464604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c294d-1689-43d4-949e-cdd29cdacadd admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.465241 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c294d-1689-43d4-949e-cdd29cdacadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.469031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c294d-1689-43d4-949e-cdd29cdacadd admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.482809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20310e36-f414-4cee-a30e-d26c0d44351b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.483904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20310e36-f414-4cee-a30e-d26c0d44351b service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.484476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20310e36-f414-4cee-a30e-d26c0d44351b service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.484989 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20310e36-f414-4cee-a30e-d26c0d44351b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.495650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20310e36-f414-4cee-a30e-d26c0d44351b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.497110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20310e36-f414-4cee-a30e-d26c0d44351b service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.506647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 817/1612] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:07.508117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fe852-f80e-42eb-b4b7-7d924e536982 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.508407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fe852-f80e-42eb-b4b7-7d924e536982 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.508690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fe852-f80e-42eb-b4b7-7d924e536982 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.510012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 818/1613] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 22 12:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:07.510746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fe852-f80e-42eb-b4b7-7d924e536982 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.521448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fe852-f80e-42eb-b4b7-7d924e536982 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.525684 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83798e46-ce16-4eb3-97a9-785b53564d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.526323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83798e46-ce16-4eb3-97a9-785b53564d54 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.533622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83798e46-ce16-4eb3-97a9-785b53564d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.533622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83798e46-ce16-4eb3-97a9-785b53564d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.536270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83798e46-ce16-4eb3-97a9-785b53564d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.537702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83798e46-ce16-4eb3-97a9-785b53564d54 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.547750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 819/1614] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:07.548525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83798e46-ce16-4eb3-97a9-785b53564d54 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.557839 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 796/1615] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:07 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:07.558127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83798e46-ce16-4eb3-97a9-785b53564d54 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.559123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8c067-b41d-4085-aa19-6db97c2b57e1 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.559413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8c067-b41d-4085-aa19-6db97c2b57e1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.559689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8c067-b41d-4085-aa19-6db97c2b57e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.588214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:07.594841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7ef8c067-b41d-4085-aa19-6db97c2b57e1 None None] MFA Rules not processed for user `b9615b91b52d47ba822426dd3b343e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:07.594841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7ef8c067-b41d-4085-aa19-6db97c2b57e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.613052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92212206-8f28-438a-add2-2e57b5cc6af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.613802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92212206-8f28-438a-add2-2e57b5cc6af2 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.614087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92212206-8f28-438a-add2-2e57b5cc6af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.614391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92212206-8f28-438a-add2-2e57b5cc6af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.660372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 797/1616] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:07.661305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8c067-b41d-4085-aa19-6db97c2b57e1 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.680455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8c067-b41d-4085-aa19-6db97c2b57e1 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.687127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bc60f-4f05-46cf-a829-3b1d73e9d467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.688863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bc60f-4f05-46cf-a829-3b1d73e9d467 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.689333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bc60f-4f05-46cf-a829-3b1d73e9d467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.689787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bc60f-4f05-46cf-a829-3b1d73e9d467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.701231 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92212206-8f28-438a-add2-2e57b5cc6af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.706087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92212206-8f28-438a-add2-2e57b5cc6af2 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.713363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bc60f-4f05-46cf-a829-3b1d73e9d467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.715520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bc60f-4f05-46cf-a829-3b1d73e9d467 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.724915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 820/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:07.726655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091433ab-cd5a-4450-9e02-19bd8e5fd571 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.727091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091433ab-cd5a-4450-9e02-19bd8e5fd571 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.727488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091433ab-cd5a-4450-9e02-19bd8e5fd571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.730123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 798/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:07.731179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bc60f-4f05-46cf-a829-3b1d73e9d467 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.749752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bc60f-4f05-46cf-a829-3b1d73e9d467 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.762270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcfb9c-2830-434f-8b17-7b415b4b69d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.763462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcfb9c-2830-434f-8b17-7b415b4b69d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.764129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcfb9c-2830-434f-8b17-7b415b4b69d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.764854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcfb9c-2830-434f-8b17-7b415b4b69d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.766147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcfb9c-2830-434f-8b17-7b415b4b69d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.771142 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcfb9c-2830-434f-8b17-7b415b4b69d6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.795218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-091433ab-cd5a-4450-9e02-19bd8e5fd571 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:07.797171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-091433ab-cd5a-4450-9e02-19bd8e5fd571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.900835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 821/1619] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 22 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:07.902599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a7d9-e22a-40ec-ae8c-5fd459eda18e None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.902924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a7d9-e22a-40ec-ae8c-5fd459eda18e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.903272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a7d9-e22a-40ec-ae8c-5fd459eda18e None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.909487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 822/1620] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 22 12:47:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:07.910465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37a7d9-e22a-40ec-ae8c-5fd459eda18e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.914639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 799/1621] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:07 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:07.919141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf3806-c33a-4078-8a63-22e3f08fb146 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.921114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf3806-c33a-4078-8a63-22e3f08fb146 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.922392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf3806-c33a-4078-8a63-22e3f08fb146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.931896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37a7d9-e22a-40ec-ae8c-5fd459eda18e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.938623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e07c3-f0e4-4b2b-bffa-14629d7b4dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.939756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e07c3-f0e4-4b2b-bffa-14629d7b4dd1 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.940161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e07c3-f0e4-4b2b-bffa-14629d7b4dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.940548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e07c3-f0e4-4b2b-bffa-14629d7b4dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.964971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-9ccf3806-c33a-4078-8a63-22e3f08fb146 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:07.969804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9ccf3806-c33a-4078-8a63-22e3f08fb146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.981413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 800/1622] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 22 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:07.982318 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf3806-c33a-4078-8a63-22e3f08fb146 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.994283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf3806-c33a-4078-8a63-22e3f08fb146 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.000336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfce6c8-4b9b-4db5-af60-f0a3b951a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.001051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfce6c8-4b9b-4db5-af60-f0a3b951a510 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.002214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfce6c8-4b9b-4db5-af60-f0a3b951a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.002512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfce6c8-4b9b-4db5-af60-f0a3b951a510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.003271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfce6c8-4b9b-4db5-af60-f0a3b951a510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.005016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfce6c8-4b9b-4db5-af60-f0a3b951a510 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.021343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 801/1623] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:08.022293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfce6c8-4b9b-4db5-af60-f0a3b951a510 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:08.042221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:08.042221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e07c3-f0e4-4b2b-bffa-14629d7b4dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.042221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e07c3-f0e4-4b2b-bffa-14629d7b4dd1 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.051853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfce6c8-4b9b-4db5-af60-f0a3b951a510 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.075412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 823/1624] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:08.075412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e07c3-f0e4-4b2b-bffa-14629d7b4dd1 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:08.075697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24df5b-8e71-4987-8b2d-86859a120097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.075697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24df5b-8e71-4987-8b2d-86859a120097 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.075697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24df5b-8e71-4987-8b2d-86859a120097 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.076461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24df5b-8e71-4987-8b2d-86859a120097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.097675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24df5b-8e71-4987-8b2d-86859a120097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.102765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24df5b-8e71-4987-8b2d-86859a120097 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.106585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e07c3-f0e4-4b2b-bffa-14629d7b4dd1 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.117615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb27d3-d79f-4472-b452-c26d68ee14b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.118950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb27d3-d79f-4472-b452-c26d68ee14b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.119958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb27d3-d79f-4472-b452-c26d68ee14b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.122616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb27d3-d79f-4472-b452-c26d68ee14b2 admin admin] PATH_INFO: `/v3/projects/d6a231597d0e4239a432d4c8f3c2858c/users/70e036321ad74d7bbba73d10a5f5dac2/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.135497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 802/1625] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:08.185501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb27d3-d79f-4472-b452-c26d68ee14b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a231597d0e4239a432d4c8f3c2858c, user_id=70e036321ad74d7bbba73d10a5f5dac2, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.188441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb27d3-d79f-4472-b452-c26d68ee14b2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.296508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 824/1626] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:08 2022] PUT /identity/v3/projects/d6a231597d0e4239a432d4c8f3c2858c/users/70e036321ad74d7bbba73d10a5f5dac2/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:08.300446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24df5b-8e71-4987-8b2d-86859a120097 service nova] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:08.348094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24df5b-8e71-4987-8b2d-86859a120097 service nova] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.453820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eb954-0e5b-4046-ab5c-e3a250f80f0f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.454479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eb954-0e5b-4046-ab5c-e3a250f80f0f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.454479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eb954-0e5b-4046-ab5c-e3a250f80f0f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.456910 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 825/1627] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 22 12:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:47:08.465907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54729a-e9fd-4c2d-b116-904c11a7b392 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.465907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54729a-e9fd-4c2d-b116-904c11a7b392 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.465907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54729a-e9fd-4c2d-b116-904c11a7b392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.475716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:08.506870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb609fa-7d5a-4fc3-80c2-c5b0ec2e92fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.508034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb609fa-7d5a-4fc3-80c2-c5b0ec2e92fb admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.508663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb609fa-7d5a-4fc3-80c2-c5b0ec2e92fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.509307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb609fa-7d5a-4fc3-80c2-c5b0ec2e92fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.509968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb609fa-7d5a-4fc3-80c2-c5b0ec2e92fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.511610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb609fa-7d5a-4fc3-80c2-c5b0ec2e92fb admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.513973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ca54729a-e9fd-4c2d-b116-904c11a7b392 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:08.521187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ca54729a-e9fd-4c2d-b116-904c11a7b392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.534904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 803/1628] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:08.541753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb609fa-7d5a-4fc3-80c2-c5b0ec2e92fb admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:08.560322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb609fa-7d5a-4fc3-80c2-c5b0ec2e92fb admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.577087 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5a4ff-1ae7-488f-a333-7fd93a1855d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.577087 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a4ff-1ae7-488f-a333-7fd93a1855d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.577472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a4ff-1ae7-488f-a333-7fd93a1855d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.577472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a4ff-1ae7-488f-a333-7fd93a1855d6 admin admin] PATH_INFO: `/v3/projects/d6a231597d0e4239a432d4c8f3c2858c/users/70e036321ad74d7bbba73d10a5f5dac2/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.581445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5a4ff-1ae7-488f-a333-7fd93a1855d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a231597d0e4239a432d4c8f3c2858c, user_id=70e036321ad74d7bbba73d10a5f5dac2, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.584042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5a4ff-1ae7-488f-a333-7fd93a1855d6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.609379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 804/1629] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:08 2022] PUT /identity/v3/projects/d6a231597d0e4239a432d4c8f3c2858c/users/70e036321ad74d7bbba73d10a5f5dac2/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:08.611117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd003e8-5253-4d63-a200-776177443808 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.611723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd003e8-5253-4d63-a200-776177443808 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.612174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd003e8-5253-4d63-a200-776177443808 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.623209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 805/1630] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 22 12:47:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:08.625947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b338be-0ddc-407c-a3aa-90d4131ce31a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.626812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b338be-0ddc-407c-a3aa-90d4131ce31a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.627606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b338be-0ddc-407c-a3aa-90d4131ce31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.685119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 826/1631] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:08.686773 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243aabb-7c3a-4915-a1fb-b59a301cba99 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.687135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243aabb-7c3a-4915-a1fb-b59a301cba99 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.687722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243aabb-7c3a-4915-a1fb-b59a301cba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.700246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c3b338be-0ddc-407c-a3aa-90d4131ce31a None None] MFA Rules not processed for user `70e036321ad74d7bbba73d10a5f5dac2`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:08.701685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c3b338be-0ddc-407c-a3aa-90d4131ce31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.739534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8243aabb-7c3a-4915-a1fb-b59a301cba99 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:08.740978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8243aabb-7c3a-4915-a1fb-b59a301cba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.810573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 806/1632] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:08.815460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b338be-0ddc-407c-a3aa-90d4131ce31a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:08.848843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 827/1633] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:08.850976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243aabb-7c3a-4915-a1fb-b59a301cba99 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:08.901201 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b338be-0ddc-407c-a3aa-90d4131ce31a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.905602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a079a4-bc55-4ad4-aa21-45b64a45b3a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.906554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a079a4-bc55-4ad4-aa21-45b64a45b3a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.906931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a079a4-bc55-4ad4-aa21-45b64a45b3a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.907442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a079a4-bc55-4ad4-aa21-45b64a45b3a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.920655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243aabb-7c3a-4915-a1fb-b59a301cba99 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.924548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a079a4-bc55-4ad4-aa21-45b64a45b3a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.925161 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a079a4-bc55-4ad4-aa21-45b64a45b3a1 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.925604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9b5d3-94c0-4eb5-a7b3-54dd9e92333a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.926611 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9b5d3-94c0-4eb5-a7b3-54dd9e92333a service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.927199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9b5d3-94c0-4eb5-a7b3-54dd9e92333a service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.927711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9b5d3-94c0-4eb5-a7b3-54dd9e92333a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.938924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:08.942458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9b5d3-94c0-4eb5-a7b3-54dd9e92333a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.942698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 807/1634] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:08.944390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9b5d3-94c0-4eb5-a7b3-54dd9e92333a service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.961844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 828/1635] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:09.166463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a079a4-bc55-4ad4-aa21-45b64a45b3a1 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:09.191217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a079a4-bc55-4ad4-aa21-45b64a45b3a1 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:09.198243 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c6f7a-6bf7-4dd0-8cde-57005edade49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:09.198881 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c6f7a-6bf7-4dd0-8cde-57005edade49 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.199211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c6f7a-6bf7-4dd0-8cde-57005edade49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.199584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c6f7a-6bf7-4dd0-8cde-57005edade49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.215516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c6f7a-6bf7-4dd0-8cde-57005edade49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:09.217921 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c6f7a-6bf7-4dd0-8cde-57005edade49 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:09.258689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 808/1636] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:09.729056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9b5d3-94c0-4eb5-a7b3-54dd9e92333a service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:09.729056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9b5d3-94c0-4eb5-a7b3-54dd9e92333a service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:09.729056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3acf7-e6d5-45d1-b0e2-d4c4a4dd2443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:09.729056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3acf7-e6d5-45d1-b0e2-d4c4a4dd2443 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.736027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3acf7-e6d5-45d1-b0e2-d4c4a4dd2443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.736027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3acf7-e6d5-45d1-b0e2-d4c4a4dd2443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.736027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3acf7-e6d5-45d1-b0e2-d4c4a4dd2443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:09.736027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3acf7-e6d5-45d1-b0e2-d4c4a4dd2443 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:09.736027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 829/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:11.019078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c6f7a-6bf7-4dd0-8cde-57005edade49 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:11.126035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:11.190783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c6f7a-6bf7-4dd0-8cde-57005edade49 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:11.206559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:11.207227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:11.207514 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:11.207793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] PATH_INFO: `/v3/users/b9615b91b52d47ba822426dd3b343e1f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:11.208947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9615b91b52d47ba822426dd3b343e1f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:11.209987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: WARNING py.warnings [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:47:11.209987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: warnings.warn(msg) Aug 22 12:47:11.209987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: Aug 22 12:47:11.211298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:11.556654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9615b91b52d47ba822426dd3b343e1f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:11.582376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9615b91b52d47ba822426dd3b343e1f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:11.716658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9615b91b52d47ba822426dd3b343e1f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:11.729723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9615b91b52d47ba822426dd3b343e1f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:11.730901 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9615b91b52d47ba822426dd3b343e1f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:11.742255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 809/1638] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:11 2022] DELETE /identity/v3/users/b9615b91b52d47ba822426dd3b343e1f => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:11.746810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2a85-6914-47f1-9414-25151d73d0e8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:11.747339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2a85-6914-47f1-9414-25151d73d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:11.747415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2a85-6914-47f1-9414-25151d73d0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:11.769482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9a4f2a85-6914-47f1-9414-25151d73d0e8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:11.770912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9a4f2a85-6914-47f1-9414-25151d73d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:11.878175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 830/1639] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:11.893313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:11.905233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:11.985504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a832-78a8-4c82-8de5-0e79d50e99fe admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:11.989558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfe53a-4c32-4a3d-b652-d530252187e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:11.990186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfe53a-4c32-4a3d-b652-d530252187e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:11.990559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfe53a-4c32-4a3d-b652-d530252187e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:11.990943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfe53a-4c32-4a3d-b652-d530252187e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.015855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfe53a-4c32-4a3d-b652-d530252187e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.018440 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfe53a-4c32-4a3d-b652-d530252187e5 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.032140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 810/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:14.123549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f2a85-6914-47f1-9414-25151d73d0e8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:14.125272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9a4f2a85-6914-47f1-9414-25151d73d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:14.163073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f2a85-6914-47f1-9414-25151d73d0e8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:14.194811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:14.196030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.196474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.196892 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] PATH_INFO: `/v3/projects/5c59a476bb484d59b29e4f9d98ba544e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:14.201814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c59a476bb484d59b29e4f9d98ba544e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:14.203167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:47:14.203167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: warnings.warn(msg) Aug 22 12:47:14.203167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: Aug 22 12:47:14.205020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:14.466832 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c59a476bb484d59b29e4f9d98ba544e', 'request_id': 'req-587d72dc-f0b6-4e64-96b5-052b9bbe050c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.493098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c59a476bb484d59b29e4f9d98ba544e', 'request_id': 'req-587d72dc-f0b6-4e64-96b5-052b9bbe050c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.579180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c59a476bb484d59b29e4f9d98ba544e', 'request_id': 'req-587d72dc-f0b6-4e64-96b5-052b9bbe050c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.677995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] The token cache is being invalidate because project 5c59a476bb484d59b29e4f9d98ba544e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:14.678475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.680833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-587d72dc-f0b6-4e64-96b5-052b9bbe050c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.684114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 831/1641] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:14 2022] DELETE /identity/v3/projects/5c59a476bb484d59b29e4f9d98ba544e => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:14.689480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317db8a8-a2e8-4501-8883-934bceb6cd19 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.689945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317db8a8-a2e8-4501-8883-934bceb6cd19 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.690031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317db8a8-a2e8-4501-8883-934bceb6cd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:14.733980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-317db8a8-a2e8-4501-8883-934bceb6cd19 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:14.735672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-317db8a8-a2e8-4501-8883-934bceb6cd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:14.986402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 811/1642] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:14.995851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0517b-c209-4c80-8252-c62b77414b66 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.996159 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0517b-c209-4c80-8252-c62b77414b66 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.996489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0517b-c209-4c80-8252-c62b77414b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.061092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-81c0517b-c209-4c80-8252-c62b77414b66 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:15.062747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-81c0517b-c209-4c80-8252-c62b77414b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:15.088021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 832/1643] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:15.091690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317db8a8-a2e8-4501-8883-934bceb6cd19 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:15.105929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317db8a8-a2e8-4501-8883-934bceb6cd19 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:15.133180 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031e2cb-253d-4900-bc0b-0726d89f3cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:15.133998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e2cb-253d-4900-bc0b-0726d89f3cea admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:15.138116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e2cb-253d-4900-bc0b-0726d89f3cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:15.138912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e2cb-253d-4900-bc0b-0726d89f3cea admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.139851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031e2cb-253d-4900-bc0b-0726d89f3cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:15.140358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031e2cb-253d-4900-bc0b-0726d89f3cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:15.142003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031e2cb-253d-4900-bc0b-0726d89f3cea admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:15.146410 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:15.158126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0517b-c209-4c80-8252-c62b77414b66 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:15.161037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-81c0517b-c209-4c80-8252-c62b77414b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:15.191699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0517b-c209-4c80-8252-c62b77414b66 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:15.218099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 812/1644] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:15.225976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031e2cb-253d-4900-bc0b-0726d89f3cea admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:15.226891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:15.227557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:15.227839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:15.228119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] PATH_INFO: `/v3/users/32a2c2ce197446289c04086e766f1bbb` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.229568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a2c2ce197446289c04086e766f1bbb)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:15.231569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:15.241747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:15.265231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031e2cb-253d-4900-bc0b-0726d89f3cea admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:15.301603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73fec-5a8c-4431-84b3-1d3eba76ea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:15.303572 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73fec-5a8c-4431-84b3-1d3eba76ea61 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:15.308066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73fec-5a8c-4431-84b3-1d3eba76ea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:15.309093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73fec-5a8c-4431-84b3-1d3eba76ea61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.310106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a73fec-5a8c-4431-84b3-1d3eba76ea61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:15.315281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a73fec-5a8c-4431-84b3-1d3eba76ea61 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:15.493738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 813/1645] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:15 2022] POST /identity/v3/projects => generated 379 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:15.498050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73fec-5a8c-4431-84b3-1d3eba76ea61 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:15.633360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a2c2ce197446289c04086e766f1bbb'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:15.635790 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a2c2ce197446289c04086e766f1bbb'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:15.663394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a2c2ce197446289c04086e766f1bbb'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:15.697198 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73fec-5a8c-4431-84b3-1d3eba76ea61 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:15.705468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece36ec-2a3c-44bb-b1f3-83224065bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:15.706786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece36ec-2a3c-44bb-b1f3-83224065bcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:15.707279 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece36ec-2a3c-44bb-b1f3-83224065bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:15.707746 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece36ec-2a3c-44bb-b1f3-83224065bcd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.713339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece36ec-2a3c-44bb-b1f3-83224065bcd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:15.715964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece36ec-2a3c-44bb-b1f3-83224065bcd6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:15.731430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a2c2ce197446289c04086e766f1bbb'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:15.842020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cee430b7-a218-4630-b0aa-4e2f9e9a3a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a2c2ce197446289c04086e766f1bbb'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:15.856661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 833/1646] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:15 2022] DELETE /identity/v3/users/32a2c2ce197446289c04086e766f1bbb => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:15.865793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec05b00-0b90-4e1f-9638-6ed6f81207a1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:15.866351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec05b00-0b90-4e1f-9638-6ed6f81207a1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:15.867344 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec05b00-0b90-4e1f-9638-6ed6f81207a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.873392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 814/1647] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:15 2022] POST /identity/v3/users => generated 290 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:15.874803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece36ec-2a3c-44bb-b1f3-83224065bcd6 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:15.877137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1ece36ec-2a3c-44bb-b1f3-83224065bcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:15.891971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece36ec-2a3c-44bb-b1f3-83224065bcd6 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:15.931364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-cec05b00-0b90-4e1f-9638-6ed6f81207a1 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:15.931364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cec05b00-0b90-4e1f-9638-6ed6f81207a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:15.992490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc17c1-182c-4c5b-a034-6c16a9ad395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:15.993439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc17c1-182c-4c5b-a034-6c16a9ad395e admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:15.993909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc17c1-182c-4c5b-a034-6c16a9ad395e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:15.994433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc17c1-182c-4c5b-a034-6c16a9ad395e admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.997592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc17c1-182c-4c5b-a034-6c16a9ad395e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:15.997592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc17c1-182c-4c5b-a034-6c16a9ad395e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:16.010002 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 815/1648] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:16.014010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc17c1-182c-4c5b-a034-6c16a9ad395e admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:16.031047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc17c1-182c-4c5b-a034-6c16a9ad395e admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:16.040438 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c95609-9270-4db6-b5e1-9334a32c193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:16.041423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c95609-9270-4db6-b5e1-9334a32c193c admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.041910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c95609-9270-4db6-b5e1-9334a32c193c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.042417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c95609-9270-4db6-b5e1-9334a32c193c admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.043297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c95609-9270-4db6-b5e1-9334a32c193c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:16.044976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c95609-9270-4db6-b5e1-9334a32c193c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:16.063380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 816/1649] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:16.067200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c95609-9270-4db6-b5e1-9334a32c193c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:16.082546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c95609-9270-4db6-b5e1-9334a32c193c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:16.089640 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ddfd-6943-4bbc-b786-658dbff69d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:16.090483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 834/1650] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:16.091919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ddfd-6943-4bbc-b786-658dbff69d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.092255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ddfd-6943-4bbc-b786-658dbff69d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.092462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ddfd-6943-4bbc-b786-658dbff69d8e admin admin] PATH_INFO: `/v3/projects/3611a69bd9964f77bc4103fb279b89a8/users/0e8fad2d43134d56998e5ed3063e9bc5/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.121203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec05b00-0b90-4e1f-9638-6ed6f81207a1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:16.124242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cec05b00-0b90-4e1f-9638-6ed6f81207a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:16.131562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39ddfd-6943-4bbc-b786-658dbff69d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3611a69bd9964f77bc4103fb279b89a8, user_id=0e8fad2d43134d56998e5ed3063e9bc5, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:16.138766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39ddfd-6943-4bbc-b786-658dbff69d8e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:16.230093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec05b00-0b90-4e1f-9638-6ed6f81207a1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:16.233363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 817/1651] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:16 2022] PUT /identity/v3/projects/3611a69bd9964f77bc4103fb279b89a8/users/0e8fad2d43134d56998e5ed3063e9bc5/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:16.243929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af57e-6424-4a85-acfc-2bd36a481f22 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.244123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af57e-6424-4a85-acfc-2bd36a481f22 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.244561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af57e-6424-4a85-acfc-2bd36a481f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.309795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ebf6c-bf9a-47ba-8e26-9b15ae84d30c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:16.311245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ebf6c-bf9a-47ba-8e26-9b15ae84d30c service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.312021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ebf6c-bf9a-47ba-8e26-9b15ae84d30c service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.312469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ebf6c-bf9a-47ba-8e26-9b15ae84d30c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.368562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-415af57e-6424-4a85-acfc-2bd36a481f22 None None] MFA Rules not processed for user `0e8fad2d43134d56998e5ed3063e9bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:16.371948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-415af57e-6424-4a85-acfc-2bd36a481f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:16.487747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ebf6c-bf9a-47ba-8e26-9b15ae84d30c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:16.487747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ebf6c-bf9a-47ba-8e26-9b15ae84d30c service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:16.511182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 835/1652] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:16.648429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 818/1653] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:16.650116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ebf6c-bf9a-47ba-8e26-9b15ae84d30c service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:16.663201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ebf6c-bf9a-47ba-8e26-9b15ae84d30c service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:16.680131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00892d1-356c-4d76-8068-5d0e7b5f690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:16.680948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00892d1-356c-4d76-8068-5d0e7b5f690b admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.681730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00892d1-356c-4d76-8068-5d0e7b5f690b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.681730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00892d1-356c-4d76-8068-5d0e7b5f690b admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.687273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00892d1-356c-4d76-8068-5d0e7b5f690b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:16.691343 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00892d1-356c-4d76-8068-5d0e7b5f690b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:16.743563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670b159-46d0-4c9c-a9ab-d5e64b480fae None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.744117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670b159-46d0-4c9c-a9ab-d5e64b480fae None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.744297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670b159-46d0-4c9c-a9ab-d5e64b480fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.785454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5670b159-46d0-4c9c-a9ab-d5e64b480fae None None] MFA Rules not processed for user `a35e0c8f7cb749de8dab38796c029bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:16.787939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5670b159-46d0-4c9c-a9ab-d5e64b480fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:16.883931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 836/1654] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:16 2022] POST /identity/v3/projects => generated 381 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:16.889425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00892d1-356c-4d76-8068-5d0e7b5f690b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:16.906848 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 819/1655] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:16.921288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afc5ea-7cde-4ab3-aa19-6a32b64251a9 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.921844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afc5ea-7cde-4ab3-aa19-6a32b64251a9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.922127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afc5ea-7cde-4ab3-aa19-6a32b64251a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.970676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-15afc5ea-7cde-4ab3-aa19-6a32b64251a9 None None] MFA Rules not processed for user `a35e0c8f7cb749de8dab38796c029bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:16.972387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-15afc5ea-7cde-4ab3-aa19-6a32b64251a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:17.015257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00892d1-356c-4d76-8068-5d0e7b5f690b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:17.029157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360948a-bc9d-4bac-9c37-b9e6994aade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:17.031240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360948a-bc9d-4bac-9c37-b9e6994aade5 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:17.032266 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360948a-bc9d-4bac-9c37-b9e6994aade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:17.033892 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360948a-bc9d-4bac-9c37-b9e6994aade5 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.036134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360948a-bc9d-4bac-9c37-b9e6994aade5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:17.043303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360948a-bc9d-4bac-9c37-b9e6994aade5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:17.107213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 820/1656] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:17.118795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afc5ea-7cde-4ab3-aa19-6a32b64251a9 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:17.120242 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-15afc5ea-7cde-4ab3-aa19-6a32b64251a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:17.141643 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:17.215421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 837/1657] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:16 2022] POST /identity/v3/users => generated 297 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:17.218766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360948a-bc9d-4bac-9c37-b9e6994aade5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:17.237597 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:17.244128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360948a-bc9d-4bac-9c37-b9e6994aade5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:17.251181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0dd1a-ca6b-4d5e-b2c2-0233fd31515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:17.253398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0dd1a-ca6b-4d5e-b2c2-0233fd31515c admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:17.253689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0dd1a-ca6b-4d5e-b2c2-0233fd31515c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:17.253969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0dd1a-ca6b-4d5e-b2c2-0233fd31515c admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.258634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0dd1a-ca6b-4d5e-b2c2-0233fd31515c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:17.262608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0dd1a-ca6b-4d5e-b2c2-0233fd31515c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:17.286855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 838/1658] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:17.298101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0dd1a-ca6b-4d5e-b2c2-0233fd31515c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:17.316226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afc5ea-7cde-4ab3-aa19-6a32b64251a9 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:17.329732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d154dd6-4051-4b28-81d1-408860328e0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:17.330923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d154dd6-4051-4b28-81d1-408860328e0e service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:17.331209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d154dd6-4051-4b28-81d1-408860328e0e service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:17.332409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d154dd6-4051-4b28-81d1-408860328e0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.339993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0dd1a-ca6b-4d5e-b2c2-0233fd31515c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:17.354045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819cad-ebbd-4e93-96ca-f34785bfc765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:17.359273 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d154dd6-4051-4b28-81d1-408860328e0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:17.367215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d154dd6-4051-4b28-81d1-408860328e0e service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:17.367397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819cad-ebbd-4e93-96ca-f34785bfc765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:17.367397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819cad-ebbd-4e93-96ca-f34785bfc765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:17.367397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819cad-ebbd-4e93-96ca-f34785bfc765 admin admin] PATH_INFO: `/v3/projects/41848276873a486c97913412ce43bf60/users/f721a7a08a5d4037879cb432cb81cc62/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.391316 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 821/1659] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:17.419019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0819cad-ebbd-4e93-96ca-f34785bfc765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41848276873a486c97913412ce43bf60, user_id=f721a7a08a5d4037879cb432cb81cc62, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:17.421873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0819cad-ebbd-4e93-96ca-f34785bfc765 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:17.486114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d154dd6-4051-4b28-81d1-408860328e0e service nova] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:17.487951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8d154dd6-4051-4b28-81d1-408860328e0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:17.522554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d154dd6-4051-4b28-81d1-408860328e0e service nova] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:17.531099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:17.532146 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:17.532433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:17.532709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] PATH_INFO: `/v3/projects/1c9877ed18184aad9d9da95c7e0103cf` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.534172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c9877ed18184aad9d9da95c7e0103cf)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:17.536442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:17.570981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 839/1660] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:17 2022] PUT /identity/v3/projects/41848276873a486c97913412ce43bf60/users/f721a7a08a5d4037879cb432cb81cc62/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:17.574335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819cad-ebbd-4e93-96ca-f34785bfc765 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:17.734169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c9877ed18184aad9d9da95c7e0103cf', 'request_id': 'req-c12865a6-5758-4585-bbf1-aaa3e761e9b4'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:17.813784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819cad-ebbd-4e93-96ca-f34785bfc765 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:17.847838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c9877ed18184aad9d9da95c7e0103cf', 'request_id': 'req-c12865a6-5758-4585-bbf1-aaa3e761e9b4'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:17.857002 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c9877ed18184aad9d9da95c7e0103cf', 'request_id': 'req-c12865a6-5758-4585-bbf1-aaa3e761e9b4'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:17.884188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] The token cache is being invalidate because project 1c9877ed18184aad9d9da95c7e0103cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:17.884726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:17.890802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:17.897704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 822/1661] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:17 2022] DELETE /identity/v3/projects/1c9877ed18184aad9d9da95c7e0103cf => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:17.899150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:17.903199 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:17.947180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6f483-0b37-4e6f-9811-2b3286f018f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:17.948482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6f483-0b37-4e6f-9811-2b3286f018f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:17.948924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6f483-0b37-4e6f-9811-2b3286f018f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:17.949506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6f483-0b37-4e6f-9811-2b3286f018f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.950811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6f483-0b37-4e6f-9811-2b3286f018f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:17.952842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6f483-0b37-4e6f-9811-2b3286f018f0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:17.994486 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 840/1662] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:17.998295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6f483-0b37-4e6f-9811-2b3286f018f0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:18.000753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7ec6f483-0b37-4e6f-9811-2b3286f018f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:18.018447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6f483-0b37-4e6f-9811-2b3286f018f0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:18.049579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6880882-d0d8-47ba-8225-5c99b5017a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:18.050831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880882-d0d8-47ba-8225-5c99b5017a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.053670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880882-d0d8-47ba-8225-5c99b5017a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.054960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880882-d0d8-47ba-8225-5c99b5017a06 admin admin] PATH_INFO: `/v3/projects/41848276873a486c97913412ce43bf60/users/f721a7a08a5d4037879cb432cb81cc62/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.067753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6880882-d0d8-47ba-8225-5c99b5017a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41848276873a486c97913412ce43bf60, user_id=f721a7a08a5d4037879cb432cb81cc62, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:18.072292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6880882-d0d8-47ba-8225-5c99b5017a06 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:18.079894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12865a6-5758-4585-bbf1-aaa3e761e9b4 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:18.086808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:18.087535 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.087822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.088429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] PATH_INFO: `/v3/users/70e036321ad74d7bbba73d10a5f5dac2` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.089861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e036321ad74d7bbba73d10a5f5dac2)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:18.092143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:18.118877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 841/1663] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:17 2022] PUT /identity/v3/projects/41848276873a486c97913412ce43bf60/users/f721a7a08a5d4037879cb432cb81cc62/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:18.131124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f290a-d577-4ec7-8490-32a6d83d8b25 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.138819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f290a-d577-4ec7-8490-32a6d83d8b25 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.138819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f290a-d577-4ec7-8490-32a6d83d8b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.162599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:18.203685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-778f290a-d577-4ec7-8490-32a6d83d8b25 None None] MFA Rules not processed for user `f721a7a08a5d4037879cb432cb81cc62`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:18.205154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-778f290a-d577-4ec7-8490-32a6d83d8b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:18.312820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 842/1664] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:18.320585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173760-a94e-4791-82d0-ebbce15cad55 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.320585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173760-a94e-4791-82d0-ebbce15cad55 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.320585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173760-a94e-4791-82d0-ebbce15cad55 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.320585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 843/1665] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 22 12:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:18.325500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356dc6-47ce-42c4-ba02-db279a8adee7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.325793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356dc6-47ce-42c4-ba02-db279a8adee7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.326066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356dc6-47ce-42c4-ba02-db279a8adee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.372885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4a356dc6-47ce-42c4-ba02-db279a8adee7 None None] MFA Rules not processed for user `948a5df1d4244c839a7faeb54f93dfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:18.374057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4a356dc6-47ce-42c4-ba02-db279a8adee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:18.381733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e036321ad74d7bbba73d10a5f5dac2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:18.398559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e036321ad74d7bbba73d10a5f5dac2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:18.464984 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 844/1666] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:47:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:18.466032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a356dc6-47ce-42c4-ba02-db279a8adee7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:18.467860 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4a356dc6-47ce-42c4-ba02-db279a8adee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:18.522039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e036321ad74d7bbba73d10a5f5dac2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:18.536405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e036321ad74d7bbba73d10a5f5dac2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:18.537272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e036321ad74d7bbba73d10a5f5dac2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:18.551007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 823/1667] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:17 2022] DELETE /identity/v3/users/70e036321ad74d7bbba73d10a5f5dac2 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:18.553535 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:18.559546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:18.581169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a356dc6-47ce-42c4-ba02-db279a8adee7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:18.603902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:18.642411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:18.699400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ffc4-aa97-45a7-a67f-4c5dbaaec29c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:18.712065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ea51-ccb7-4c8f-b623-47335959b0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:18.712709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ea51-ccb7-4c8f-b623-47335959b0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.712995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ea51-ccb7-4c8f-b623-47335959b0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.713273 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ea51-ccb7-4c8f-b623-47335959b0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.715149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3e80ea51-ccb7-4c8f-b623-47335959b0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:18.733836 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80ea51-ccb7-4c8f-b623-47335959b0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:18.735507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80ea51-ccb7-4c8f-b623-47335959b0b0 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:18.748211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6588d-aadb-4d6e-a872-bc22deef395c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:18.748943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6588d-aadb-4d6e-a872-bc22deef395c service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.749415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6588d-aadb-4d6e-a872-bc22deef395c service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.749697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6588d-aadb-4d6e-a872-bc22deef395c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.754709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aeb6588d-aadb-4d6e-a872-bc22deef395c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:18.759357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 824/1668] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:18.911108 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6588d-aadb-4d6e-a872-bc22deef395c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:18.913972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6588d-aadb-4d6e-a872-bc22deef395c service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:18.944544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 845/1669] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:19.247350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ea51-ccb7-4c8f-b623-47335959b0b0 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:19.249499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3e80ea51-ccb7-4c8f-b623-47335959b0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:19.269559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ea51-ccb7-4c8f-b623-47335959b0b0 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:19.281629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b9c27-e15b-4264-85c9-ebb07c4eb213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:19.283817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b9c27-e15b-4264-85c9-ebb07c4eb213 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:19.284384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b9c27-e15b-4264-85c9-ebb07c4eb213 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:19.287099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b9c27-e15b-4264-85c9-ebb07c4eb213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:19.293258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-dd7b9c27-e15b-4264-85c9-ebb07c4eb213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:19.466477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b9c27-e15b-4264-85c9-ebb07c4eb213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:19.470027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b9c27-e15b-4264-85c9-ebb07c4eb213 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:19.510680 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 825/1670] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:19.625344 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:19.904118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6588d-aadb-4d6e-a872-bc22deef395c service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:19.914643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aeb6588d-aadb-4d6e-a872-bc22deef395c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:20.074932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6588d-aadb-4d6e-a872-bc22deef395c service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:20.094977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:20.097647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:20.098728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:20.099107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] PATH_INFO: `/v3/users/1279a39542b54796a00665928bb57e9c` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:20.102444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1279a39542b54796a00665928bb57e9c)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:20.104642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:20.131093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b9c27-e15b-4264-85c9-ebb07c4eb213 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:20.133871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-dd7b9c27-e15b-4264-85c9-ebb07c4eb213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:20.159756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b9c27-e15b-4264-85c9-ebb07c4eb213 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:20.177327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:20.178003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:20.178316 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:20.178596 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] PATH_INFO: `/v3/projects/d6a231597d0e4239a432d4c8f3c2858c` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:20.187099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a231597d0e4239a432d4c8f3c2858c)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:20.207238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:20.531005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a231597d0e4239a432d4c8f3c2858c', 'request_id': 'req-4eaa51a1-260c-4519-9c92-c1f1945910e4'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:20.543157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1279a39542b54796a00665928bb57e9c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:20.544906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1279a39542b54796a00665928bb57e9c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:20.555676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1279a39542b54796a00665928bb57e9c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:20.588577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1279a39542b54796a00665928bb57e9c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:20.705141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a231597d0e4239a432d4c8f3c2858c', 'request_id': 'req-4eaa51a1-260c-4519-9c92-c1f1945910e4'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:20.720591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a231597d0e4239a432d4c8f3c2858c', 'request_id': 'req-4eaa51a1-260c-4519-9c92-c1f1945910e4'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:20.736287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:20.752650 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] The token cache is being invalidate because project d6a231597d0e4239a432d4c8f3c2858c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:20.753356 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:20.755576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4eaa51a1-260c-4519-9c92-c1f1945910e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:20.759136 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 826/1671] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:20 2022] DELETE /identity/v3/projects/d6a231597d0e4239a432d4c8f3c2858c => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:20.772049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec45a7a-d65e-47f4-9200-493d04847ad3 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:20.772049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec45a7a-d65e-47f4-9200-493d04847ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:20.772049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec45a7a-d65e-47f4-9200-493d04847ad3 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:20.772049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 827/1672] 10.222.0.23 () {54 vars in 961 bytes} [Mon Aug 22 12:47:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:20.772049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54a4c-18de-4add-b350-540110a895a9 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:20.773681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54a4c-18de-4add-b350-540110a895a9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:20.774001 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54a4c-18de-4add-b350-540110a895a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:20.831370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ae77985d-6407-4bdf-b758-8f6013376326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1279a39542b54796a00665928bb57e9c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:20.842233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 846/1673] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:19 2022] DELETE /identity/v3/users/1279a39542b54796a00665928bb57e9c => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:20.857945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993bd2-429f-47ad-9c81-4e3ccc2f9bc6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:20.857945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993bd2-429f-47ad-9c81-4e3ccc2f9bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:20.857945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993bd2-429f-47ad-9c81-4e3ccc2f9bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:20.858304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-afb54a4c-18de-4add-b350-540110a895a9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:20.858304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-afb54a4c-18de-4add-b350-540110a895a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:20.924974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d6993bd2-429f-47ad-9c81-4e3ccc2f9bc6 None None] MFA Rules not processed for user `6fa8495c97df48f18b10039584d52f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:20.934891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d6993bd2-429f-47ad-9c81-4e3ccc2f9bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:21.014354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 828/1674] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:21.014354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62cd08-83cc-4e7d-a223-52fde43d4f52 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:21.014354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62cd08-83cc-4e7d-a223-52fde43d4f52 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:21.014354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62cd08-83cc-4e7d-a223-52fde43d4f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:21.033946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-cf62cd08-83cc-4e7d-a223-52fde43d4f52 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:21.035592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cf62cd08-83cc-4e7d-a223-52fde43d4f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:21.052693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 829/1675] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:21.054870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0abd-afb8-47c8-ba74-bc359858bd3e None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:21.055524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0abd-afb8-47c8-ba74-bc359858bd3e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:21.055908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0abd-afb8-47c8-ba74-bc359858bd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:21.079420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-cb3e0abd-afb8-47c8-ba74-bc359858bd3e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:21.080704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cb3e0abd-afb8-47c8-ba74-bc359858bd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:21.098635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 830/1676] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:21.098635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0abd-afb8-47c8-ba74-bc359858bd3e None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:21.098635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cb3e0abd-afb8-47c8-ba74-bc359858bd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:21.115386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 847/1677] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Aug 22 12:47:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:21.116349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6993bd2-429f-47ad-9c81-4e3ccc2f9bc6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:21.128229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6993bd2-429f-47ad-9c81-4e3ccc2f9bc6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:21.134069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41203e61-e63f-4a8f-9a74-bd8d4e436a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:21.136048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41203e61-e63f-4a8f-9a74-bd8d4e436a23 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:21.136048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41203e61-e63f-4a8f-9a74-bd8d4e436a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:21.136048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41203e61-e63f-4a8f-9a74-bd8d4e436a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:21.136502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41203e61-e63f-4a8f-9a74-bd8d4e436a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:21.137239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41203e61-e63f-4a8f-9a74-bd8d4e436a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:21.138478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41203e61-e63f-4a8f-9a74-bd8d4e436a23 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:21.156203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 848/1678] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:21.156203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41203e61-e63f-4a8f-9a74-bd8d4e436a23 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:21.167033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41203e61-e63f-4a8f-9a74-bd8d4e436a23 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:21.173338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec01b1-76de-454a-aa89-2a19b78d2fff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8495c97df48f18b10039584d52f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:21.173988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec01b1-76de-454a-aa89-2a19b78d2fff service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:21.174302 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec01b1-76de-454a-aa89-2a19b78d2fff service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:21.174583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec01b1-76de-454a-aa89-2a19b78d2fff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:21.176781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-46ec01b1-76de-454a-aa89-2a19b78d2fff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:21.178431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0abd-afb8-47c8-ba74-bc359858bd3e None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:21.182870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9710c-6aea-4648-838d-79832e5077d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:21.183574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9710c-6aea-4648-838d-79832e5077d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:21.183873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9710c-6aea-4648-838d-79832e5077d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:21.184155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9710c-6aea-4648-838d-79832e5077d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:21.195546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9710c-6aea-4648-838d-79832e5077d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:21.196235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec01b1-76de-454a-aa89-2a19b78d2fff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:21.197563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9710c-6aea-4648-838d-79832e5077d1 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:21.197892 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec01b1-76de-454a-aa89-2a19b78d2fff service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:21.209220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 831/1680] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:21.209422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 849/1680] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:21.210300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9710c-6aea-4648-838d-79832e5077d1 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:21.224209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9710c-6aea-4648-838d-79832e5077d1 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:21.231243 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0ce8b-0c03-4b48-a70f-011ff135bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:21.232100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0ce8b-0c03-4b48-a70f-011ff135bdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:21.232431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0ce8b-0c03-4b48-a70f-011ff135bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:21.232720 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0ce8b-0c03-4b48-a70f-011ff135bdf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:21.233496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0ce8b-0c03-4b48-a70f-011ff135bdf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:21.235549 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0ce8b-0c03-4b48-a70f-011ff135bdf4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:21.385767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:21.527044 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 832/1681] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:21 2022] POST /identity/v3/projects => generated 387 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:21.528476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec01b1-76de-454a-aa89-2a19b78d2fff service placement] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:21.558140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec01b1-76de-454a-aa89-2a19b78d2fff service placement] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:21.788303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9784aba-eb7a-4d8c-9f8e-69c39498f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:21.795194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9784aba-eb7a-4d8c-9f8e-69c39498f566 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:21.795471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9784aba-eb7a-4d8c-9f8e-69c39498f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:21.800811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9784aba-eb7a-4d8c-9f8e-69c39498f566 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:21.800811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9784aba-eb7a-4d8c-9f8e-69c39498f566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:21.800811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9784aba-eb7a-4d8c-9f8e-69c39498f566 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:21.999603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 850/1682] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:21 2022] POST /identity/v3/users => generated 294 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:22.005560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0ce8b-0c03-4b48-a70f-011ff135bdf4 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:22.035072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0ce8b-0c03-4b48-a70f-011ff135bdf4 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:22.042001 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fc7e5-d604-41c6-92e6-f90f9fde0769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:22.044046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fc7e5-d604-41c6-92e6-f90f9fde0769 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:22.044046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fc7e5-d604-41c6-92e6-f90f9fde0769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:22.044046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fc7e5-d604-41c6-92e6-f90f9fde0769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:22.044454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fc7e5-d604-41c6-92e6-f90f9fde0769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:22.046604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fc7e5-d604-41c6-92e6-f90f9fde0769 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:22.060813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 833/1683] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:22.064607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9784aba-eb7a-4d8c-9f8e-69c39498f566 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:22.078632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9784aba-eb7a-4d8c-9f8e-69c39498f566 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:22.086905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c6125-5579-423d-9e6c-c3848e12f87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:22.088016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c6125-5579-423d-9e6c-c3848e12f87a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:22.088465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c6125-5579-423d-9e6c-c3848e12f87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:22.089040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c6125-5579-423d-9e6c-c3848e12f87a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:22.090267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c6125-5579-423d-9e6c-c3848e12f87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:22.092852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c6125-5579-423d-9e6c-c3848e12f87a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:22.112206 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 851/1684] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:22.119323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fc7e5-d604-41c6-92e6-f90f9fde0769 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:22.134544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fc7e5-d604-41c6-92e6-f90f9fde0769 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:22.148349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8de5b-9790-4946-9180-892d303fd3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:22.149323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8de5b-9790-4946-9180-892d303fd3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:22.149765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8de5b-9790-4946-9180-892d303fd3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:22.150183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8de5b-9790-4946-9180-892d303fd3e7 admin admin] PATH_INFO: `/v3/projects/485b757a4a864869be4d1a3eeb812fe5/users/2a2d1a00b77c48ffae9c5e509e250bff/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:22.202480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8de5b-9790-4946-9180-892d303fd3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=485b757a4a864869be4d1a3eeb812fe5, user_id=2a2d1a00b77c48ffae9c5e509e250bff, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:22.209501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8de5b-9790-4946-9180-892d303fd3e7 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:22.421912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 834/1685] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:22 2022] PUT /identity/v3/projects/485b757a4a864869be4d1a3eeb812fe5/users/2a2d1a00b77c48ffae9c5e509e250bff/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:22.431244 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc21e29-bd27-4840-9fb6-8d2e1c3cb85e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:22.431523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc21e29-bd27-4840-9fb6-8d2e1c3cb85e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:22.431948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc21e29-bd27-4840-9fb6-8d2e1c3cb85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:22.508215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-abc21e29-bd27-4840-9fb6-8d2e1c3cb85e None None] MFA Rules not processed for user `2a2d1a00b77c48ffae9c5e509e250bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:22.509515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-abc21e29-bd27-4840-9fb6-8d2e1c3cb85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:22.579309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:22.680214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 852/1686] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:22.685290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8de5b-9790-4946-9180-892d303fd3e7 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:22.837684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8de5b-9790-4946-9180-892d303fd3e7 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:22.853853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cddef-1dd8-4509-bce6-b9279366009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:22.854529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cddef-1dd8-4509-bce6-b9279366009a admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:22.854837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cddef-1dd8-4509-bce6-b9279366009a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:22.857664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cddef-1dd8-4509-bce6-b9279366009a admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:22.858700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cddef-1dd8-4509-bce6-b9279366009a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:22.864144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cddef-1dd8-4509-bce6-b9279366009a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:23.106127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 835/1687] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:22 2022] POST /identity/v3/projects => generated 385 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:23.109852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc21e29-bd27-4840-9fb6-8d2e1c3cb85e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:23.129959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc21e29-bd27-4840-9fb6-8d2e1c3cb85e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:23.304002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375d59-7b7e-458d-9653-63e688ab7418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:23.305350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375d59-7b7e-458d-9653-63e688ab7418 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:23.306273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375d59-7b7e-458d-9653-63e688ab7418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:23.306700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375d59-7b7e-458d-9653-63e688ab7418 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:23.307520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0375d59-7b7e-458d-9653-63e688ab7418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:23.310857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0375d59-7b7e-458d-9653-63e688ab7418 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:23.428763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 853/1688] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:23 2022] POST /identity/v3/users => generated 299 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:23.428897 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cddef-1dd8-4509-bce6-b9279366009a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:23.444961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cddef-1dd8-4509-bce6-b9279366009a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:23.452589 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a815073-61c4-44d2-b9fb-aba266a0c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:23.454359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a815073-61c4-44d2-b9fb-aba266a0c5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:23.457811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a815073-61c4-44d2-b9fb-aba266a0c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:23.457811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a815073-61c4-44d2-b9fb-aba266a0c5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:23.457811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a815073-61c4-44d2-b9fb-aba266a0c5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:23.458569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a815073-61c4-44d2-b9fb-aba266a0c5c9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:23.473327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 836/1689] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:23.478118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375d59-7b7e-458d-9653-63e688ab7418 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:23.493698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375d59-7b7e-458d-9653-63e688ab7418 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:23.514849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b1485-248a-41f0-9145-05eccbdffdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:23.515532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b1485-248a-41f0-9145-05eccbdffdd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:23.515821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b1485-248a-41f0-9145-05eccbdffdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:23.516105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b1485-248a-41f0-9145-05eccbdffdd4 admin admin] PATH_INFO: `/v3/projects/ec1afeaa976d49e4afa02f284be9bb17/users/1e4de35fe65c47379293fb136a692a75/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:23.546126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b1485-248a-41f0-9145-05eccbdffdd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1afeaa976d49e4afa02f284be9bb17, user_id=1e4de35fe65c47379293fb136a692a75, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:23.550316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b1485-248a-41f0-9145-05eccbdffdd4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:23.643262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 854/1690] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:23 2022] PUT /identity/v3/projects/ec1afeaa976d49e4afa02f284be9bb17/users/1e4de35fe65c47379293fb136a692a75/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:23.647222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a815073-61c4-44d2-b9fb-aba266a0c5c9 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:23.668169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a815073-61c4-44d2-b9fb-aba266a0c5c9 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:23.740772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b1485-248a-41f0-9145-05eccbdffdd4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:23.743267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-572b1485-248a-41f0-9145-05eccbdffdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:23.782335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf2b2c-7064-49ac-a5d8-188942dac25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:23.784515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf2b2c-7064-49ac-a5d8-188942dac25d admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:23.784842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf2b2c-7064-49ac-a5d8-188942dac25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:23.785275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf2b2c-7064-49ac-a5d8-188942dac25d admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:23.785947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf2b2c-7064-49ac-a5d8-188942dac25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:23.796818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf2b2c-7064-49ac-a5d8-188942dac25d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:23.819382 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 837/1691] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:23.822590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf2b2c-7064-49ac-a5d8-188942dac25d admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:23.853749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf2b2c-7064-49ac-a5d8-188942dac25d admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:23.872765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbafe4-3ec3-42cc-95e8-e7c4a5afa690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:23.874010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbafe4-3ec3-42cc-95e8-e7c4a5afa690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:23.874330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbafe4-3ec3-42cc-95e8-e7c4a5afa690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:23.874659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbafe4-3ec3-42cc-95e8-e7c4a5afa690 admin admin] PATH_INFO: `/v3/projects/ec1afeaa976d49e4afa02f284be9bb17/users/1e4de35fe65c47379293fb136a692a75/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:23.881430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:23.887833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbafe4-3ec3-42cc-95e8-e7c4a5afa690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1afeaa976d49e4afa02f284be9bb17, user_id=1e4de35fe65c47379293fb136a692a75, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:23.893322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbafe4-3ec3-42cc-95e8-e7c4a5afa690 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:23.915675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b1485-248a-41f0-9145-05eccbdffdd4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:23.925637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:23.926469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:23.927191 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:23.927853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] PATH_INFO: `/v3/projects/572855546ca54e1793a3fbd419e38d19` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:23.930559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572855546ca54e1793a3fbd419e38d19)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:23.943611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 838/1692] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:23 2022] PUT /identity/v3/projects/ec1afeaa976d49e4afa02f284be9bb17/users/1e4de35fe65c47379293fb136a692a75/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:23.943933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:23.944150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea124e9-9fa9-4e02-ac33-c21ed20f2ec9 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:23.944447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea124e9-9fa9-4e02-ac33-c21ed20f2ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:23.944732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea124e9-9fa9-4e02-ac33-c21ed20f2ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:24.041391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-bea124e9-9fa9-4e02-ac33-c21ed20f2ec9 None None] MFA Rules not processed for user `1e4de35fe65c47379293fb136a692a75`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:24.042654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bea124e9-9fa9-4e02-ac33-c21ed20f2ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:24.217108 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572855546ca54e1793a3fbd419e38d19', 'request_id': 'req-a0f4b27b-7adb-4922-85d2-9a717c6b3243'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:24.231102 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 839/1693] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:24.243375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572855546ca54e1793a3fbd419e38d19', 'request_id': 'req-a0f4b27b-7adb-4922-85d2-9a717c6b3243'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:24.243991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea124e9-9fa9-4e02-ac33-c21ed20f2ec9 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:24.246758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bea124e9-9fa9-4e02-ac33-c21ed20f2ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:24.360400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572855546ca54e1793a3fbd419e38d19', 'request_id': 'req-a0f4b27b-7adb-4922-85d2-9a717c6b3243'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:24.384573 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] The token cache is being invalidate because project 572855546ca54e1793a3fbd419e38d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:24.387999 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:24.390493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a0f4b27b-7adb-4922-85d2-9a717c6b3243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:24.396269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 855/1694] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:23 2022] DELETE /identity/v3/projects/572855546ca54e1793a3fbd419e38d19 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:24.402108 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a1b72-25ce-49b7-8ee2-3284edfce4a6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:24.403760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea124e9-9fa9-4e02-ac33-c21ed20f2ec9 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:24.409530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a1b72-25ce-49b7-8ee2-3284edfce4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:24.410399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a1b72-25ce-49b7-8ee2-3284edfce4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:24.510703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b25a1b72-25ce-49b7-8ee2-3284edfce4a6 None None] MFA Rules not processed for user `6e5963aeb4514b80a3d786da8a05da0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:24.511968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b25a1b72-25ce-49b7-8ee2-3284edfce4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:24.599204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a5015-0103-480b-92b5-8c63d2050593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:24.600424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5015-0103-480b-92b5-8c63d2050593 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:24.600968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5015-0103-480b-92b5-8c63d2050593 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:24.602653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5015-0103-480b-92b5-8c63d2050593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:24.608917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-166a5015-0103-480b-92b5-8c63d2050593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:24.747421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 856/1695] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:24.747421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc8ad5-9eb1-4684-be10-10266524bb19 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:24.747421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc8ad5-9eb1-4684-be10-10266524bb19 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:24.747421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc8ad5-9eb1-4684-be10-10266524bb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:24.777714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a5015-0103-480b-92b5-8c63d2050593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:24.779414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a5015-0103-480b-92b5-8c63d2050593 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:24.798718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0fcc8ad5-9eb1-4684-be10-10266524bb19 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:24.804100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0fcc8ad5-9eb1-4684-be10-10266524bb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:24.811007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 840/1696] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:24.814861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a5015-0103-480b-92b5-8c63d2050593 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:24.818855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-166a5015-0103-480b-92b5-8c63d2050593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:24.992509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 857/1697] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:24.994328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc8ad5-9eb1-4684-be10-10266524bb19 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:24.996339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0fcc8ad5-9eb1-4684-be10-10266524bb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:25.012953 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc8ad5-9eb1-4684-be10-10266524bb19 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:25.024270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:25.025257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:25.026299 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:25.026661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] PATH_INFO: `/v3/users/2a2d1a00b77c48ffae9c5e509e250bff` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:25.028172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2d1a00b77c48ffae9c5e509e250bff)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:25.032304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:25.089034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a5015-0103-480b-92b5-8c63d2050593 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:25.104288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcca1f9-236f-4e69-8d52-11d8a42bccab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:25.104931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcca1f9-236f-4e69-8d52-11d8a42bccab service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:25.105208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcca1f9-236f-4e69-8d52-11d8a42bccab service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:25.105483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcca1f9-236f-4e69-8d52-11d8a42bccab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:25.114616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcca1f9-236f-4e69-8d52-11d8a42bccab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:25.116555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcca1f9-236f-4e69-8d52-11d8a42bccab service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:25.146653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 841/1698] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:25.148394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0d1c-1ff4-411c-bf09-be61aa1206d2 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:25.148798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0d1c-1ff4-411c-bf09-be61aa1206d2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:25.160229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0d1c-1ff4-411c-bf09-be61aa1206d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:25.220738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-68ca0d1c-1ff4-411c-bf09-be61aa1206d2 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:25.221972 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-68ca0d1c-1ff4-411c-bf09-be61aa1206d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:25.249497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 842/1699] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:25.254398 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca0d1c-1ff4-411c-bf09-be61aa1206d2 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:25.275726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca0d1c-1ff4-411c-bf09-be61aa1206d2 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:25.290937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7efb1b-80f6-4adb-b88e-f6cb4dfbe31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:25.291802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7efb1b-80f6-4adb-b88e-f6cb4dfbe31a admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:25.292457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7efb1b-80f6-4adb-b88e-f6cb4dfbe31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:25.292911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7efb1b-80f6-4adb-b88e-f6cb4dfbe31a admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:25.296071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7efb1b-80f6-4adb-b88e-f6cb4dfbe31a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:25.297060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7efb1b-80f6-4adb-b88e-f6cb4dfbe31a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:25.300294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7efb1b-80f6-4adb-b88e-f6cb4dfbe31a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:25.306724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2d1a00b77c48ffae9c5e509e250bff'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:25.311817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2d1a00b77c48ffae9c5e509e250bff'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:25.345650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:25.348738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 843/1700] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:25.349452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2d1a00b77c48ffae9c5e509e250bff'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:25.349834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7efb1b-80f6-4adb-b88e-f6cb4dfbe31a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:25.352964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-de7efb1b-80f6-4adb-b88e-f6cb4dfbe31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:25.384443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2d1a00b77c48ffae9c5e509e250bff'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:25.386485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7efb1b-80f6-4adb-b88e-f6cb4dfbe31a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:25.417037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cad064-1a88-48c2-b786-9bfd9b16ec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:25.424386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cad064-1a88-48c2-b786-9bfd9b16ec34 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:25.424386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cad064-1a88-48c2-b786-9bfd9b16ec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:25.424386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cad064-1a88-48c2-b786-9bfd9b16ec34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:25.424386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cad064-1a88-48c2-b786-9bfd9b16ec34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:25.424386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cad064-1a88-48c2-b786-9bfd9b16ec34 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:25.461774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:25.516449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-88660f45-9c0c-4e6b-b6ce-79a323e0987d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2d1a00b77c48ffae9c5e509e250bff'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:25.530290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 858/1701] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:24 2022] DELETE /identity/v3/users/2a2d1a00b77c48ffae9c5e509e250bff => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:25.532166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947f9eb-f585-4092-9392-33c3bd06e832 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:25.532637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947f9eb-f585-4092-9392-33c3bd06e832 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:25.533065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947f9eb-f585-4092-9392-33c3bd06e832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:25.597747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7947f9eb-f585-4092-9392-33c3bd06e832 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:25.599032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7947f9eb-f585-4092-9392-33c3bd06e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:25.614635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 844/1702] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:25 2022] POST /identity/v3/projects => generated 373 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:25.620883 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cad064-1a88-48c2-b786-9bfd9b16ec34 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:25.774815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 859/1703] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:25.776279 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af15a-9123-4ca2-9368-2b0633bb86e4 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:25.776575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af15a-9123-4ca2-9368-2b0633bb86e4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:25.776856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af15a-9123-4ca2-9368-2b0633bb86e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:25.798485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cad064-1a88-48c2-b786-9bfd9b16ec34 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:25.822173 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3754c-6207-4f9d-9eb9-3a06a0e333a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:25.822948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3754c-6207-4f9d-9eb9-3a06a0e333a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:25.823277 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3754c-6207-4f9d-9eb9-3a06a0e333a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:25.823606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3754c-6207-4f9d-9eb9-3a06a0e333a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:25.825429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3754c-6207-4f9d-9eb9-3a06a0e333a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:25.837407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3754c-6207-4f9d-9eb9-3a06a0e333a3 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:25.843984 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2a4af15a-9123-4ca2-9368-2b0633bb86e4 None None] MFA Rules not processed for user `a26f0791dd7741ae8ff4065dc43f099e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:25.845955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2a4af15a-9123-4ca2-9368-2b0633bb86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:25.968594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 845/1704] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:25 2022] POST /identity/v3/users => generated 287 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:25.972567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3754c-6207-4f9d-9eb9-3a06a0e333a3 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:25.983189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-18c3754c-6207-4f9d-9eb9-3a06a0e333a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:26.009402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 860/1705] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:26.010873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af15a-9123-4ca2-9368-2b0633bb86e4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:26.045178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af15a-9123-4ca2-9368-2b0633bb86e4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:26.055855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cbcbb-36e0-4901-9d1f-f822084b29fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:26.056745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbcbb-36e0-4901-9d1f-f822084b29fe admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:26.057081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbcbb-36e0-4901-9d1f-f822084b29fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:26.057430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbcbb-36e0-4901-9d1f-f822084b29fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:26.058143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cbcbb-36e0-4901-9d1f-f822084b29fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:26.061063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cbcbb-36e0-4901-9d1f-f822084b29fe admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:26.089272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 861/1706] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:26.092024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cbcbb-36e0-4901-9d1f-f822084b29fe admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:26.094813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-168cbcbb-36e0-4901-9d1f-f822084b29fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:26.148146 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3754c-6207-4f9d-9eb9-3a06a0e333a3 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:26.156090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec80a5c-da8f-4498-9233-4a50f2419596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:26.156454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec80a5c-da8f-4498-9233-4a50f2419596 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:26.156741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec80a5c-da8f-4498-9233-4a50f2419596 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:26.157064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec80a5c-da8f-4498-9233-4a50f2419596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:26.180384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec80a5c-da8f-4498-9233-4a50f2419596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:26.181942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec80a5c-da8f-4498-9233-4a50f2419596 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:26.208613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 846/1707] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:26.209665 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec80a5c-da8f-4498-9233-4a50f2419596 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:26.231501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec80a5c-da8f-4498-9233-4a50f2419596 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:26.246108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67787df2-c44a-4cf8-ae94-348c93f0ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:26.246785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67787df2-c44a-4cf8-ae94-348c93f0ceb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:26.248116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67787df2-c44a-4cf8-ae94-348c93f0ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:26.249812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67787df2-c44a-4cf8-ae94-348c93f0ceb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:26.250519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67787df2-c44a-4cf8-ae94-348c93f0ceb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:26.252250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67787df2-c44a-4cf8-ae94-348c93f0ceb6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:26.283710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 847/1708] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:26.288644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67787df2-c44a-4cf8-ae94-348c93f0ceb6 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:26.319048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cbcbb-36e0-4901-9d1f-f822084b29fe admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:26.326806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67787df2-c44a-4cf8-ae94-348c93f0ceb6 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:26.332540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89eb5f-7029-4a72-ac41-390418566e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:26.334661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89eb5f-7029-4a72-ac41-390418566e93 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:26.336093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89eb5f-7029-4a72-ac41-390418566e93 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:26.337567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89eb5f-7029-4a72-ac41-390418566e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:26.345081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b824fc-fc49-48e6-ab34-f20922171d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:26.345081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b824fc-fc49-48e6-ab34-f20922171d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:26.345081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b824fc-fc49-48e6-ab34-f20922171d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:26.345081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b824fc-fc49-48e6-ab34-f20922171d04 admin admin] PATH_INFO: `/v3/projects/e8348d226b0e4fc6a333de954da5a64d/users/d063df3a699041788bebe160f5de1047/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:26.357474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89eb5f-7029-4a72-ac41-390418566e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:26.362764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89eb5f-7029-4a72-ac41-390418566e93 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:26.379566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b824fc-fc49-48e6-ab34-f20922171d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8348d226b0e4fc6a333de954da5a64d, user_id=d063df3a699041788bebe160f5de1047, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:26.385933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 862/1709] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:26.386782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b824fc-fc49-48e6-ab34-f20922171d04 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:26.485722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 848/1710] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:26 2022] PUT /identity/v3/projects/e8348d226b0e4fc6a333de954da5a64d/users/d063df3a699041788bebe160f5de1047/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:26.499670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163232c-5043-4569-ae26-aed2af262486 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:26.500012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163232c-5043-4569-ae26-aed2af262486 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:26.500298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163232c-5043-4569-ae26-aed2af262486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:26.553397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d163232c-5043-4569-ae26-aed2af262486 None None] MFA Rules not processed for user `d063df3a699041788bebe160f5de1047`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:26.557042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d163232c-5043-4569-ae26-aed2af262486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:26.745774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 863/1711] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:26.750890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:26.765471 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b824fc-fc49-48e6-ab34-f20922171d04 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:26.767387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-84b824fc-fc49-48e6-ab34-f20922171d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:26.842185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:27.044100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b824fc-fc49-48e6-ab34-f20922171d04 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:27.059073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8bcda-0b88-4a22-8bf1-8e15790dcbc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:27.064789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bcda-0b88-4a22-8bf1-8e15790dcbc8 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:27.064789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bcda-0b88-4a22-8bf1-8e15790dcbc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:27.066536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bcda-0b88-4a22-8bf1-8e15790dcbc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:27.099747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8bcda-0b88-4a22-8bf1-8e15790dcbc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:27.108423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8bcda-0b88-4a22-8bf1-8e15790dcbc8 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:27.144550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 849/1712] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:27.409939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4fd2-b91c-46e4-b3c4-6eea13845961 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:27.410862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4fd2-b91c-46e4-b3c4-6eea13845961 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:27.411294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4fd2-b91c-46e4-b3c4-6eea13845961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:27.556517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:27.562926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-bfef4fd2-b91c-46e4-b3c4-6eea13845961 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:27.564155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bfef4fd2-b91c-46e4-b3c4-6eea13845961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:27.794590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 864/1713] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:47:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:28.124328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06b357-4811-4eca-b8ff-aad719466bf6 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:28.125076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06b357-4811-4eca-b8ff-aad719466bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:28.125495 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06b357-4811-4eca-b8ff-aad719466bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:28.188000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ab06b357-4811-4eca-b8ff-aad719466bf6 None None] MFA Rules not processed for user `4489cb4f8ec144468b8308ba0a809539`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:28.189507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ab06b357-4811-4eca-b8ff-aad719466bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:28.313350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 850/1714] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:28.339107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef4fd2-b91c-46e4-b3c4-6eea13845961 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:28.340592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06b357-4811-4eca-b8ff-aad719466bf6 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:28.342870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bfef4fd2-b91c-46e4-b3c4-6eea13845961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:28.366017 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06b357-4811-4eca-b8ff-aad719466bf6 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:28.414828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c8a7a-baac-4c14-97a4-5e2d4b4985fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:28.414828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8a7a-baac-4c14-97a4-5e2d4b4985fc service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:28.414828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8a7a-baac-4c14-97a4-5e2d4b4985fc service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:28.414828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8a7a-baac-4c14-97a4-5e2d4b4985fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:28.453559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c8a7a-baac-4c14-97a4-5e2d4b4985fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:28.455409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c8a7a-baac-4c14-97a4-5e2d4b4985fc service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:28.483779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 851/1715] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:28.484753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c8a7a-baac-4c14-97a4-5e2d4b4985fc service nova] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:28.492497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d56c8a7a-baac-4c14-97a4-5e2d4b4985fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:28.517897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef4fd2-b91c-46e4-b3c4-6eea13845961 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:28.524632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:28.528199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:28.528199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:28.528199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] PATH_INFO: `/v3/projects/485b757a4a864869be4d1a3eeb812fe5` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:28.529415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485b757a4a864869be4d1a3eeb812fe5)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:28.531913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:28.723166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485b757a4a864869be4d1a3eeb812fe5', 'request_id': 'req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:28.732895 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485b757a4a864869be4d1a3eeb812fe5', 'request_id': 'req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:28.746474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c8a7a-baac-4c14-97a4-5e2d4b4985fc service nova] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:28.872378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485b757a4a864869be4d1a3eeb812fe5', 'request_id': 'req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:28.894148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] The token cache is being invalidate because project 485b757a4a864869be4d1a3eeb812fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:28.894755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:28.899465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:28.904579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 865/1716] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:28 2022] DELETE /identity/v3/projects/485b757a4a864869be4d1a3eeb812fe5 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:28.905824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:28.915280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:28.961855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a61b09-adb2-4b9e-bd0b-9c6a6492ecfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:28.962648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a61b09-adb2-4b9e-bd0b-9c6a6492ecfc service swift] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:28.962937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a61b09-adb2-4b9e-bd0b-9c6a6492ecfc service swift] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:28.963220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a61b09-adb2-4b9e-bd0b-9c6a6492ecfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:28.965228 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e0a61b09-adb2-4b9e-bd0b-9c6a6492ecfc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:29.072173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:29.084523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ce720-8e9a-498f-91ab-b35c7b77bcd6 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:29.099547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:29.100364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:29.100746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:29.101869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] PATH_INFO: `/v3/users/1e4de35fe65c47379293fb136a692a75` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:29.107027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4de35fe65c47379293fb136a692a75)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:29.109386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:29.128090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a61b09-adb2-4b9e-bd0b-9c6a6492ecfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:29.135407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a61b09-adb2-4b9e-bd0b-9c6a6492ecfc service swift] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:29.192045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 852/1717] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:47:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:47:29.304867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:29.442794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4de35fe65c47379293fb136a692a75'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:29.448550 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4de35fe65c47379293fb136a692a75'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:29.458226 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4de35fe65c47379293fb136a692a75'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:29.485408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4de35fe65c47379293fb136a692a75'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:29.745071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4de35fe65c47379293fb136a692a75'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:29.761477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 866/1718] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:28 2022] DELETE /identity/v3/users/1e4de35fe65c47379293fb136a692a75 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:31.566892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a61b09-adb2-4b9e-bd0b-9c6a6492ecfc service swift] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:31.568574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e0a61b09-adb2-4b9e-bd0b-9c6a6492ecfc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:31.587338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a61b09-adb2-4b9e-bd0b-9c6a6492ecfc service swift] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:31.693503 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:31.695517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:31.780678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:31.784519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:31.785069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:31.787636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] PATH_INFO: `/v3/users/d063df3a699041788bebe160f5de1047` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:31.791954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d063df3a699041788bebe160f5de1047)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:31.798036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:31.861863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65391c35-adc5-44f0-8403-c5b214336cd6 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:31.886622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:31.888551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:31.888888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:31.890525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] PATH_INFO: `/v3/projects/ec1afeaa976d49e4afa02f284be9bb17` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:31.895032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1afeaa976d49e4afa02f284be9bb17)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:31.897044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:32.315328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd063df3a699041788bebe160f5de1047'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:32.319947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:32.329359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1afeaa976d49e4afa02f284be9bb17', 'request_id': 'req-5bec8782-d6c1-4df5-a576-99e694754f3c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:32.344362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1afeaa976d49e4afa02f284be9bb17', 'request_id': 'req-5bec8782-d6c1-4df5-a576-99e694754f3c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:32.369202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:32.378042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd063df3a699041788bebe160f5de1047'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:32.442224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1afeaa976d49e4afa02f284be9bb17', 'request_id': 'req-5bec8782-d6c1-4df5-a576-99e694754f3c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:32.464375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] The token cache is being invalidate because project ec1afeaa976d49e4afa02f284be9bb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:32.464987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:32.465756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bec8782-d6c1-4df5-a576-99e694754f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:32.472361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 867/1719] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:31 2022] DELETE /identity/v3/projects/ec1afeaa976d49e4afa02f284be9bb17 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:32.477370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b806d-50f7-4385-9898-166fd9e4a530 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:32.477370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b806d-50f7-4385-9898-166fd9e4a530 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:32.477705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b806d-50f7-4385-9898-166fd9e4a530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:32.530575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1e5b806d-50f7-4385-9898-166fd9e4a530 None None] MFA Rules not processed for user `23cfeac2a23e4f82a2d515db5c46ab6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:32.532397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1e5b806d-50f7-4385-9898-166fd9e4a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:32.539684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd063df3a699041788bebe160f5de1047'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:32.548797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd063df3a699041788bebe160f5de1047'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:32.554911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7a180669-96cd-462e-9aae-72ab0de20ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd063df3a699041788bebe160f5de1047'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:32.592014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 853/1720] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:31 2022] DELETE /identity/v3/users/d063df3a699041788bebe160f5de1047 => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:32.594730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593228d8-3277-4e8f-921b-910c1d41213a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:32.595021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593228d8-3277-4e8f-921b-910c1d41213a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:32.595306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593228d8-3277-4e8f-921b-910c1d41213a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:32.683449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-593228d8-3277-4e8f-921b-910c1d41213a None None] MFA Rules not processed for user `948a5df1d4244c839a7faeb54f93dfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:32.688330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-593228d8-3277-4e8f-921b-910c1d41213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:32.704353 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 868/1721] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:32.708861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c56bc-47a1-4edd-8e5e-bda4b3bb36c9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:32.708861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c56bc-47a1-4edd-8e5e-bda4b3bb36c9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:32.708861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c56bc-47a1-4edd-8e5e-bda4b3bb36c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:32.756170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c30c56bc-47a1-4edd-8e5e-bda4b3bb36c9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:32.761166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c30c56bc-47a1-4edd-8e5e-bda4b3bb36c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:32.876127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 854/1722] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Aug 22 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:32.883204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714b1c3-2e34-453c-be88-6cb743ed1e6b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:32.888555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714b1c3-2e34-453c-be88-6cb743ed1e6b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:32.888555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714b1c3-2e34-453c-be88-6cb743ed1e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:32.888761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 869/1723] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:32.888761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612c401-1ca7-4070-84aa-8eba7d35cd53 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:32.888761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612c401-1ca7-4070-84aa-8eba7d35cd53 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:32.888761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612c401-1ca7-4070-84aa-8eba7d35cd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:32.925393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c714b1c3-2e34-453c-be88-6cb743ed1e6b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:32.925393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c714b1c3-2e34-453c-be88-6cb743ed1e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:32.925654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d612c401-1ca7-4070-84aa-8eba7d35cd53 None None] MFA Rules not processed for user `23cfeac2a23e4f82a2d515db5c46ab6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:32.945145 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 855/1724] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:32.945890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d612c401-1ca7-4070-84aa-8eba7d35cd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:32.950558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafa712-3ec2-415a-b5c2-26a7e797ab0c None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:32.950861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafa712-3ec2-415a-b5c2-26a7e797ab0c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:32.951126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafa712-3ec2-415a-b5c2-26a7e797ab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:33.007383 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6bafa712-3ec2-415a-b5c2-26a7e797ab0c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:33.009780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6bafa712-3ec2-415a-b5c2-26a7e797ab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:33.021326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 856/1725] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:33.028683 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafa712-3ec2-415a-b5c2-26a7e797ab0c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:33.028683 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6bafa712-3ec2-415a-b5c2-26a7e797ab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:33.049767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafa712-3ec2-415a-b5c2-26a7e797ab0c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:33.060680 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861d6ad-ede5-48d0-8e80-46da8bf4aa24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:33.061322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861d6ad-ede5-48d0-8e80-46da8bf4aa24 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:33.063801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861d6ad-ede5-48d0-8e80-46da8bf4aa24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:33.067062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861d6ad-ede5-48d0-8e80-46da8bf4aa24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:33.085138 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861d6ad-ede5-48d0-8e80-46da8bf4aa24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:33.087643 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861d6ad-ede5-48d0-8e80-46da8bf4aa24 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:33.101504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 857/1726] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:33.103070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861d6ad-ede5-48d0-8e80-46da8bf4aa24 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:33.116333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861d6ad-ede5-48d0-8e80-46da8bf4aa24 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:33.122292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea836d-10a6-427d-8b62-2b318f45da5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:33.123290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea836d-10a6-427d-8b62-2b318f45da5c service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:33.123732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea836d-10a6-427d-8b62-2b318f45da5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:33.124461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea836d-10a6-427d-8b62-2b318f45da5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:33.158928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea836d-10a6-427d-8b62-2b318f45da5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:33.161628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea836d-10a6-427d-8b62-2b318f45da5c service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:33.185573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 858/1727] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:33.186733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea836d-10a6-427d-8b62-2b318f45da5c service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:33.191013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 870/1728] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:33.210636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea836d-10a6-427d-8b62-2b318f45da5c service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:33.211326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612c401-1ca7-4070-84aa-8eba7d35cd53 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:33.215802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d612c401-1ca7-4070-84aa-8eba7d35cd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:33.216030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808fe3b-13c8-487c-aab7-d6450015b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:33.216843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808fe3b-13c8-487c-aab7-d6450015b2df admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:33.217393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808fe3b-13c8-487c-aab7-d6450015b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:33.218628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808fe3b-13c8-487c-aab7-d6450015b2df admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:33.219719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808fe3b-13c8-487c-aab7-d6450015b2df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:33.220032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808fe3b-13c8-487c-aab7-d6450015b2df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:33.221956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808fe3b-13c8-487c-aab7-d6450015b2df admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:33.242840 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 859/1729] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:33.246923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808fe3b-13c8-487c-aab7-d6450015b2df admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:33.265338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808fe3b-13c8-487c-aab7-d6450015b2df admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:33.273129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfa13e-0983-4f47-842b-0264961c523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:33.273129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfa13e-0983-4f47-842b-0264961c523b admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:33.273129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfa13e-0983-4f47-842b-0264961c523b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:33.273129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfa13e-0983-4f47-842b-0264961c523b admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:33.273762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfa13e-0983-4f47-842b-0264961c523b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:33.275319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfa13e-0983-4f47-842b-0264961c523b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:33.441622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 860/1730] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:33 2022] POST /identity/v3/projects => generated 409 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:33.442146 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfa13e-0983-4f47-842b-0264961c523b admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:33.443853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:33.447118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-58cfa13e-0983-4f47-842b-0264961c523b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:33.487583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612c401-1ca7-4070-84aa-8eba7d35cd53 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:33.657007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfa13e-0983-4f47-842b-0264961c523b admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:33.671757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:33.672441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:33.672730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:33.673012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] PATH_INFO: `/v3/users/0e8fad2d43134d56998e5ed3063e9bc5` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:33.675634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8fad2d43134d56998e5ed3063e9bc5)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:33.682279 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:33.737316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e6ad2-0769-4da3-891d-3c0477f222df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:33.740259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e6ad2-0769-4da3-891d-3c0477f222df service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:33.740259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e6ad2-0769-4da3-891d-3c0477f222df service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:33.740259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e6ad2-0769-4da3-891d-3c0477f222df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:33.981193 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e6ad2-0769-4da3-891d-3c0477f222df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:33.989694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e6ad2-0769-4da3-891d-3c0477f222df service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:34.011632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 871/1731] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:34.012798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e6ad2-0769-4da3-891d-3c0477f222df service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:34.025822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e6ad2-0769-4da3-891d-3c0477f222df service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:34.028949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8fad2d43134d56998e5ed3063e9bc5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:34.032316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5281c1a-e2d9-4fd2-9812-93c02d710d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:34.033123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5281c1a-e2d9-4fd2-9812-93c02d710d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:34.033475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5281c1a-e2d9-4fd2-9812-93c02d710d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:34.033847 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5281c1a-e2d9-4fd2-9812-93c02d710d6b admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:34.036051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5281c1a-e2d9-4fd2-9812-93c02d710d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:34.038299 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5281c1a-e2d9-4fd2-9812-93c02d710d6b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:34.085947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8fad2d43134d56998e5ed3063e9bc5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:34.111829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:34.159705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 872/1732] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:34 2022] POST /identity/v3/users => generated 305 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:34.164204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5281c1a-e2d9-4fd2-9812-93c02d710d6b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:34.207856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5281c1a-e2d9-4fd2-9812-93c02d710d6b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:34.242862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8fad2d43134d56998e5ed3063e9bc5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:34.255867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8fad2d43134d56998e5ed3063e9bc5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:34.256948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a5528cf5-84f7-483b-aab3-ed7a3a29c3d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8fad2d43134d56998e5ed3063e9bc5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:34.267391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc02b21-9ca6-44bf-a38f-9fa5d8417c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:34.268032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc02b21-9ca6-44bf-a38f-9fa5d8417c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:34.282005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc02b21-9ca6-44bf-a38f-9fa5d8417c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:34.282624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc02b21-9ca6-44bf-a38f-9fa5d8417c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:34.286116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc02b21-9ca6-44bf-a38f-9fa5d8417c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:34.289750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 861/1733] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:33 2022] DELETE /identity/v3/users/0e8fad2d43134d56998e5ed3063e9bc5 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:34.290438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc02b21-9ca6-44bf-a38f-9fa5d8417c38 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:34.295709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e2d6-0fd6-45dd-84b9-c1ee07405cce None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:34.296225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e2d6-0fd6-45dd-84b9-c1ee07405cce None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:34.296669 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e2d6-0fd6-45dd-84b9-c1ee07405cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:34.326078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 873/1734] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:34.330741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc02b21-9ca6-44bf-a38f-9fa5d8417c38 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:34.336155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ebc02b21-9ca6-44bf-a38f-9fa5d8417c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:34.367208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1292e2d6-0fd6-45dd-84b9-c1ee07405cce None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:34.370476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1292e2d6-0fd6-45dd-84b9-c1ee07405cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:34.374660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc02b21-9ca6-44bf-a38f-9fa5d8417c38 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:34.468371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dcacc-071e-4636-992b-7421b6867698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:34.469396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dcacc-071e-4636-992b-7421b6867698 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:34.470521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dcacc-071e-4636-992b-7421b6867698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:34.470938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dcacc-071e-4636-992b-7421b6867698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:34.471673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dcacc-071e-4636-992b-7421b6867698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:34.473637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dcacc-071e-4636-992b-7421b6867698 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:34.488648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 874/1735] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:34.494466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dcacc-071e-4636-992b-7421b6867698 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:34.539412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dcacc-071e-4636-992b-7421b6867698 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:34.559061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c25ea-9508-445f-a594-6e72e57a9cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:34.560660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c25ea-9508-445f-a594-6e72e57a9cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:34.560660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c25ea-9508-445f-a594-6e72e57a9cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:34.570114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c25ea-9508-445f-a594-6e72e57a9cf5 admin admin] PATH_INFO: `/v3/projects/4f66f44382ca4ea88ecfcca2221f28a5/users/87da8c29b01348a598853ada9a9fd964/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:34.579957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 862/1736] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:34.629399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c25ea-9508-445f-a594-6e72e57a9cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f66f44382ca4ea88ecfcca2221f28a5, user_id=87da8c29b01348a598853ada9a9fd964, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:34.634705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d301b7a-b2e0-4326-a747-a240fbb5390f None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:34.634992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d301b7a-b2e0-4326-a747-a240fbb5390f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:34.635270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d301b7a-b2e0-4326-a747-a240fbb5390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:34.638440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c25ea-9508-445f-a594-6e72e57a9cf5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:34.679756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-4d301b7a-b2e0-4326-a747-a240fbb5390f None None] MFA Rules not processed for user `6e5963aeb4514b80a3d786da8a05da0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:34.685965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-4d301b7a-b2e0-4326-a747-a240fbb5390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:34.756985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 875/1737] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:34 2022] PUT /identity/v3/projects/4f66f44382ca4ea88ecfcca2221f28a5/users/87da8c29b01348a598853ada9a9fd964/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:34.760154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c25ea-9508-445f-a594-6e72e57a9cf5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:34.765231 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-678c25ea-9508-445f-a594-6e72e57a9cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:34.833668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 863/1738] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:34.837870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf238e-1443-454d-887f-ab015745d5e8 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:34.839068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf238e-1443-454d-887f-ab015745d5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:34.840794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf238e-1443-454d-887f-ab015745d5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:34.901101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c25ea-9508-445f-a594-6e72e57a9cf5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:34.904668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-2faf238e-1443-454d-887f-ab015745d5e8 None None] MFA Rules not processed for user `87da8c29b01348a598853ada9a9fd964`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:34.908653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2faf238e-1443-454d-887f-ab015745d5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:34.910592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63bd76-86b3-4885-b3b5-906978637088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:34.912638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63bd76-86b3-4885-b3b5-906978637088 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:34.914092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63bd76-86b3-4885-b3b5-906978637088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:34.917075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63bd76-86b3-4885-b3b5-906978637088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:35.042315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63bd76-86b3-4885-b3b5-906978637088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:35.053473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63bd76-86b3-4885-b3b5-906978637088 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:35.059465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 864/1739] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:35.060900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad786b4-ed2e-4a99-946d-2e3e5167408f None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:35.063355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad786b4-ed2e-4a99-946d-2e3e5167408f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:35.064008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad786b4-ed2e-4a99-946d-2e3e5167408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:35.080171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 876/1740] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:35.085254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63bd76-86b3-4885-b3b5-906978637088 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:35.117688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63bd76-86b3-4885-b3b5-906978637088 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:35.131050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37ed76-bf9a-456f-b4cc-92d1a3b9b7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:35.131811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37ed76-bf9a-456f-b4cc-92d1a3b9b7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:35.132181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37ed76-bf9a-456f-b4cc-92d1a3b9b7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:35.133798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37ed76-bf9a-456f-b4cc-92d1a3b9b7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:35.135898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37ed76-bf9a-456f-b4cc-92d1a3b9b7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:35.139072 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37ed76-bf9a-456f-b4cc-92d1a3b9b7f9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:35.140964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-aad786b4-ed2e-4a99-946d-2e3e5167408f None None] MFA Rules not processed for user `a26f0791dd7741ae8ff4065dc43f099e`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:35.146601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-aad786b4-ed2e-4a99-946d-2e3e5167408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:35.301467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 865/1741] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:35.313019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 877/1742] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:35 2022] POST /identity/v3/projects => generated 407 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:35.317661 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad786b4-ed2e-4a99-946d-2e3e5167408f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:35.348229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad786b4-ed2e-4a99-946d-2e3e5167408f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:35.463415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b8ca4-12f3-459d-a887-0ef314f2fce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:35.464429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b8ca4-12f3-459d-a887-0ef314f2fce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:35.465181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b8ca4-12f3-459d-a887-0ef314f2fce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:35.465625 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b8ca4-12f3-459d-a887-0ef314f2fce7 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:35.466835 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b8ca4-12f3-459d-a887-0ef314f2fce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:35.469378 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b8ca4-12f3-459d-a887-0ef314f2fce7 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:35.646683 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 866/1743] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:35 2022] POST /identity/v3/users => generated 310 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:35.651603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37ed76-bf9a-456f-b4cc-92d1a3b9b7f9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:35.666502 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37ed76-bf9a-456f-b4cc-92d1a3b9b7f9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:35.672886 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509128d2-5bb6-4885-8617-e9ae574f3529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:35.673676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509128d2-5bb6-4885-8617-e9ae574f3529 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:35.674118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509128d2-5bb6-4885-8617-e9ae574f3529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:35.674526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509128d2-5bb6-4885-8617-e9ae574f3529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:35.675467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509128d2-5bb6-4885-8617-e9ae574f3529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:35.677329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509128d2-5bb6-4885-8617-e9ae574f3529 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:35.710269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 878/1744] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:35.711865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b8ca4-12f3-459d-a887-0ef314f2fce7 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:35.725941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b8ca4-12f3-459d-a887-0ef314f2fce7 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:35.733074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799376a0-1c1a-45e2-a066-e55aa0da5f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:35.733982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799376a0-1c1a-45e2-a066-e55aa0da5f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:35.734523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799376a0-1c1a-45e2-a066-e55aa0da5f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:35.735009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799376a0-1c1a-45e2-a066-e55aa0da5f3a admin admin] PATH_INFO: `/v3/projects/fd704aa3d2114c279f390397e0d97057/users/5d196c5fbd9c4f1b997f4ab52caccf2d/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:35.756639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799376a0-1c1a-45e2-a066-e55aa0da5f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd704aa3d2114c279f390397e0d97057, user_id=5d196c5fbd9c4f1b997f4ab52caccf2d, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:35.761997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799376a0-1c1a-45e2-a066-e55aa0da5f3a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:35.924052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 867/1745] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:35 2022] PUT /identity/v3/projects/fd704aa3d2114c279f390397e0d97057/users/5d196c5fbd9c4f1b997f4ab52caccf2d/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:35.928508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509128d2-5bb6-4885-8617-e9ae574f3529 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:35.941721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509128d2-5bb6-4885-8617-e9ae574f3529 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:36.075672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2449f-eb6f-4b52-b54e-54e55e5a4219 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:36.076049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2449f-eb6f-4b52-b54e-54e55e5a4219 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:36.077833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2449f-eb6f-4b52-b54e-54e55e5a4219 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:36.078410 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 868/1746] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:36.108286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325e0ca-1e48-45be-8b47-75d526f1f425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:36.109383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325e0ca-1e48-45be-8b47-75d526f1f425 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:36.109905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45edfce-528e-4629-a796-bf49bc42210e None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:36.110289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45edfce-528e-4629-a796-bf49bc42210e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:36.110420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325e0ca-1e48-45be-8b47-75d526f1f425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:36.110716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45edfce-528e-4629-a796-bf49bc42210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:36.111082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325e0ca-1e48-45be-8b47-75d526f1f425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:36.112155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325e0ca-1e48-45be-8b47-75d526f1f425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:36.114097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325e0ca-1e48-45be-8b47-75d526f1f425 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:36.140242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 879/1747] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:36.146980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325e0ca-1e48-45be-8b47-75d526f1f425 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:36.146980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d325e0ca-1e48-45be-8b47-75d526f1f425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:36.151403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a45edfce-528e-4629-a796-bf49bc42210e None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:36.152830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a45edfce-528e-4629-a796-bf49bc42210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:36.164109 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325e0ca-1e48-45be-8b47-75d526f1f425 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:36.188504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:36.190077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:36.192498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:36.193367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] PATH_INFO: `/v3/projects/3611a69bd9964f77bc4103fb279b89a8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:36.196893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3611a69bd9964f77bc4103fb279b89a8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:36.201541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:36.288009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:36.325631 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 869/1748] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:36.332712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb820-3919-4754-85ff-4e25b165269c None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:36.333798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb820-3919-4754-85ff-4e25b165269c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:36.335030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb820-3919-4754-85ff-4e25b165269c None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:36.341480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 870/1749] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 22 12:47:36 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:36.346818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cb820-3919-4754-85ff-4e25b165269c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:36.382708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3611a69bd9964f77bc4103fb279b89a8', 'request_id': 'req-755ac266-777e-41bb-bb4a-c807a14de60e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:36.401785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3611a69bd9964f77bc4103fb279b89a8', 'request_id': 'req-755ac266-777e-41bb-bb4a-c807a14de60e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:36.488632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3611a69bd9964f77bc4103fb279b89a8', 'request_id': 'req-755ac266-777e-41bb-bb4a-c807a14de60e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:36.509368 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] The token cache is being invalidate because project 3611a69bd9964f77bc4103fb279b89a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:36.509653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:36.510389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:36.512332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 880/1750] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:36 2022] DELETE /identity/v3/projects/3611a69bd9964f77bc4103fb279b89a8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:36.513290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:36.515519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:36.543066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cb820-3919-4754-85ff-4e25b165269c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:36.555483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac266-777e-41bb-bb4a-c807a14de60e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:36.581476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b13ea-5409-48d5-8258-496a75ec3e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:36.581720 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:36.582603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b13ea-5409-48d5-8258-496a75ec3e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:36.583228 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b13ea-5409-48d5-8258-496a75ec3e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:36.583666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b13ea-5409-48d5-8258-496a75ec3e00 admin admin] PATH_INFO: `/v3/projects/fd704aa3d2114c279f390397e0d97057/users/5d196c5fbd9c4f1b997f4ab52caccf2d/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:36.586300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:36.586683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:36.587194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] PATH_INFO: `/v3/projects/e8348d226b0e4fc6a333de954da5a64d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:36.588923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8348d226b0e4fc6a333de954da5a64d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:36.590389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b13ea-5409-48d5-8258-496a75ec3e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd704aa3d2114c279f390397e0d97057, user_id=5d196c5fbd9c4f1b997f4ab52caccf2d, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:36.596853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b13ea-5409-48d5-8258-496a75ec3e00 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:36.597467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:36.638991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 871/1751] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:36 2022] PUT /identity/v3/projects/fd704aa3d2114c279f390397e0d97057/users/5d196c5fbd9c4f1b997f4ab52caccf2d/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:36.641925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d761e-c44d-41a4-bddd-7c0f67d072bf None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:36.642443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d761e-c44d-41a4-bddd-7c0f67d072bf None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:36.643802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d761e-c44d-41a4-bddd-7c0f67d072bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:36.679718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a41d761e-c44d-41a4-bddd-7c0f67d072bf None None] MFA Rules not processed for user `948a5df1d4244c839a7faeb54f93dfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:36.686887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a41d761e-c44d-41a4-bddd-7c0f67d072bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:36.778164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 872/1752] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:36.779146 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d761e-c44d-41a4-bddd-7c0f67d072bf None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:36.780527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a41d761e-c44d-41a4-bddd-7c0f67d072bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:36.891029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8348d226b0e4fc6a333de954da5a64d', 'request_id': 'req-14513be8-2ddb-4da1-b03f-720e95790b77'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:36.908054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d761e-c44d-41a4-bddd-7c0f67d072bf None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:36.921939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8348d226b0e4fc6a333de954da5a64d', 'request_id': 'req-14513be8-2ddb-4da1-b03f-720e95790b77'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:37.009338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8348d226b0e4fc6a333de954da5a64d', 'request_id': 'req-14513be8-2ddb-4da1-b03f-720e95790b77'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:37.021736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:37.038395 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] The token cache is being invalidate because project e8348d226b0e4fc6a333de954da5a64d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:37.039608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:37.046601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14513be8-2ddb-4da1-b03f-720e95790b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:37.051441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 881/1753] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:36 2022] DELETE /identity/v3/projects/e8348d226b0e4fc6a333de954da5a64d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:37.055820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58034b-f6ba-4c5f-b9ac-6bf5c7d4680a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:37.056153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58034b-f6ba-4c5f-b9ac-6bf5c7d4680a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:37.056480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58034b-f6ba-4c5f-b9ac-6bf5c7d4680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:37.059682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:37.073235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:37.073584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:37.073876 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] PATH_INFO: `/v3/users/f721a7a08a5d4037879cb432cb81cc62` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:37.076077 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=f721a7a08a5d4037879cb432cb81cc62)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:37.084818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:37.213447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7c58034b-f6ba-4c5f-b9ac-6bf5c7d4680a None None] MFA Rules not processed for user `5d196c5fbd9c4f1b997f4ab52caccf2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:37.217447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7c58034b-f6ba-4c5f-b9ac-6bf5c7d4680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:37.446654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 882/1754] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:37.451555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58034b-f6ba-4c5f-b9ac-6bf5c7d4680a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:37.463406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7c58034b-f6ba-4c5f-b9ac-6bf5c7d4680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:37.509724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f721a7a08a5d4037879cb432cb81cc62'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:37.624939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f721a7a08a5d4037879cb432cb81cc62'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:37.805326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58034b-f6ba-4c5f-b9ac-6bf5c7d4680a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:37.823557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd0b8c-03ac-4b0e-b0fa-b8838df9a84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:37.824519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd0b8c-03ac-4b0e-b0fa-b8838df9a84e service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:37.825383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd0b8c-03ac-4b0e-b0fa-b8838df9a84e service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:37.825868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd0b8c-03ac-4b0e-b0fa-b8838df9a84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:37.833054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c0cd0b8c-03ac-4b0e-b0fa-b8838df9a84e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:37.858876 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f721a7a08a5d4037879cb432cb81cc62'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:37.871301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f721a7a08a5d4037879cb432cb81cc62'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:37.879633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a94b42ee-3704-4ead-a0d9-972c87344bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f721a7a08a5d4037879cb432cb81cc62'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:37.895312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd0b8c-03ac-4b0e-b0fa-b8838df9a84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:37.896796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd0b8c-03ac-4b0e-b0fa-b8838df9a84e service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:37.912957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 873/1755] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:36 2022] DELETE /identity/v3/users/f721a7a08a5d4037879cb432cb81cc62 => generated 0 bytes in 1134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:37.929344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed588-89da-450b-becf-37c8f886988e None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:37.929570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed588-89da-450b-becf-37c8f886988e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:37.929765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed588-89da-450b-becf-37c8f886988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:37.963463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 883/1756] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:37.964922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4ab7d-6807-42b8-b70e-71efe368bac2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:37.965224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4ab7d-6807-42b8-b70e-71efe368bac2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:37.965506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4ab7d-6807-42b8-b70e-71efe368bac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:38.046060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-3a3ed588-89da-450b-becf-37c8f886988e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:38.046060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3a3ed588-89da-450b-becf-37c8f886988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:38.065388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a5c4ab7d-6807-42b8-b70e-71efe368bac2 None None] MFA Rules not processed for user `4489cb4f8ec144468b8308ba0a809539`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:38.070485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a5c4ab7d-6807-42b8-b70e-71efe368bac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:38.312324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 874/1757] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:38.314026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ed588-89da-450b-becf-37c8f886988e None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:38.324158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3a3ed588-89da-450b-becf-37c8f886988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:38.326071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 884/1758] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:38.327831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92830a-20c0-4b0d-b551-c2bbab734e79 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:38.329216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92830a-20c0-4b0d-b551-c2bbab734e79 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:38.329696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92830a-20c0-4b0d-b551-c2bbab734e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:38.383118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9c92830a-20c0-4b0d-b551-c2bbab734e79 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:38.384404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9c92830a-20c0-4b0d-b551-c2bbab734e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:38.410495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 885/1759] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:38.416957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92830a-20c0-4b0d-b551-c2bbab734e79 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:38.443695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92830a-20c0-4b0d-b551-c2bbab734e79 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:38.457554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7035e1-065e-4fa6-a36c-ee8356a065a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:38.459425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7035e1-065e-4fa6-a36c-ee8356a065a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:38.459781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7035e1-065e-4fa6-a36c-ee8356a065a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:38.471722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7035e1-065e-4fa6-a36c-ee8356a065a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:38.473948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7035e1-065e-4fa6-a36c-ee8356a065a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:38.475082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7035e1-065e-4fa6-a36c-ee8356a065a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:38.481155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7035e1-065e-4fa6-a36c-ee8356a065a8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:38.496173 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ed588-89da-450b-becf-37c8f886988e None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:38.511134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bb667-d87d-4d31-bba2-436c7b307426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:38.514185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bb667-d87d-4d31-bba2-436c7b307426 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:38.514185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bb667-d87d-4d31-bba2-436c7b307426 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:38.514185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bb667-d87d-4d31-bba2-436c7b307426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:38.518396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-917bb667-d87d-4d31-bba2-436c7b307426 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:38.519893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 886/1760] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:38.522551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7035e1-065e-4fa6-a36c-ee8356a065a8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:38.547613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7035e1-065e-4fa6-a36c-ee8356a065a8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:38.557151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f99c56-2d62-4960-b839-9742d35babd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:38.558263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f99c56-2d62-4960-b839-9742d35babd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:38.558763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f99c56-2d62-4960-b839-9742d35babd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:38.559234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f99c56-2d62-4960-b839-9742d35babd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:38.560150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f99c56-2d62-4960-b839-9742d35babd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:38.564298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f99c56-2d62-4960-b839-9742d35babd3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:38.730640 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bb667-d87d-4d31-bba2-436c7b307426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:38.732342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bb667-d87d-4d31-bba2-436c7b307426 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:38.769095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 875/1761] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:38.772576 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 887/1762] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:38 2022] POST /identity/v3/projects => generated 367 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:38.783692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bb667-d87d-4d31-bba2-436c7b307426 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:38.818069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bb667-d87d-4d31-bba2-436c7b307426 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:39.010982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007dc4-5713-4e68-9182-2b95a994850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:39.012814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007dc4-5713-4e68-9182-2b95a994850b admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.014752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007dc4-5713-4e68-9182-2b95a994850b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.015126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007dc4-5713-4e68-9182-2b95a994850b admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.015834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84007dc4-5713-4e68-9182-2b95a994850b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:39.020079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84007dc4-5713-4e68-9182-2b95a994850b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:39.206816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 876/1763] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:38 2022] POST /identity/v3/users => generated 284 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:39.208411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f99c56-2d62-4960-b839-9742d35babd3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:39.228755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f99c56-2d62-4960-b839-9742d35babd3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:39.242846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193ed8b-3de2-41f2-8336-41cad6f7862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:39.243749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193ed8b-3de2-41f2-8336-41cad6f7862d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.256148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193ed8b-3de2-41f2-8336-41cad6f7862d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.256767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193ed8b-3de2-41f2-8336-41cad6f7862d admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.258283 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193ed8b-3de2-41f2-8336-41cad6f7862d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:39.262913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193ed8b-3de2-41f2-8336-41cad6f7862d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:39.317881 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007dc4-5713-4e68-9182-2b95a994850b admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:39.325787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 888/1764] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:39.361595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007dc4-5713-4e68-9182-2b95a994850b admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:39.390985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d9f10-c411-4d17-a0a4-c11ee4a11383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:39.399299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d9f10-c411-4d17-a0a4-c11ee4a11383 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.401310 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d9f10-c411-4d17-a0a4-c11ee4a11383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.407533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d9f10-c411-4d17-a0a4-c11ee4a11383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.407533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d9f10-c411-4d17-a0a4-c11ee4a11383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:39.407533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d9f10-c411-4d17-a0a4-c11ee4a11383 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:39.459999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 877/1765] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:39.461642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193ed8b-3de2-41f2-8336-41cad6f7862d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:39.480230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193ed8b-3de2-41f2-8336-41cad6f7862d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:39.504724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6740d-970e-4237-b99d-309bf2d67361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:39.505679 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6740d-970e-4237-b99d-309bf2d67361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.510765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6740d-970e-4237-b99d-309bf2d67361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.510765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6740d-970e-4237-b99d-309bf2d67361 admin admin] PATH_INFO: `/v3/projects/cb448cae2bef43fe8236e221c50d911e/users/12ec1542d64d4a9bb4ffa958ac719033/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.545545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6740d-970e-4237-b99d-309bf2d67361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb448cae2bef43fe8236e221c50d911e, user_id=12ec1542d64d4a9bb4ffa958ac719033, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:39.552194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6740d-970e-4237-b99d-309bf2d67361 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:39.563742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d9f10-c411-4d17-a0a4-c11ee4a11383 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:39.660752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 889/1766] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:39 2022] PUT /identity/v3/projects/cb448cae2bef43fe8236e221c50d911e/users/12ec1542d64d4a9bb4ffa958ac719033/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:39.660752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6740d-970e-4237-b99d-309bf2d67361 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:39.663042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-32b6740d-970e-4237-b99d-309bf2d67361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:39.742377 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d9f10-c411-4d17-a0a4-c11ee4a11383 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:39.868080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7d257-9b0a-4b56-a20c-7fe72903900f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:39.869114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7d257-9b0a-4b56-a20c-7fe72903900f service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.869770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7d257-9b0a-4b56-a20c-7fe72903900f service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.871718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7d257-9b0a-4b56-a20c-7fe72903900f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.881854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-35a7d257-9b0a-4b56-a20c-7fe72903900f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:39.929042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6740d-970e-4237-b99d-309bf2d67361 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:39.946956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:39.947753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.948374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.950462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] PATH_INFO: `/v3/projects/41848276873a486c97913412ce43bf60` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.954841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41848276873a486c97913412ce43bf60)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:39.965994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:40.046840 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7d257-9b0a-4b56-a20c-7fe72903900f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:40.052042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7d257-9b0a-4b56-a20c-7fe72903900f service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:40.082288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 878/1767] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:40.087276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404bd29-4e51-4d11-a5ef-69c16333e670 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:40.087580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404bd29-4e51-4d11-a5ef-69c16333e670 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:40.088323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404bd29-4e51-4d11-a5ef-69c16333e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:40.162789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-2404bd29-4e51-4d11-a5ef-69c16333e670 None None] MFA Rules not processed for user `12ec1542d64d4a9bb4ffa958ac719033`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:40.164674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2404bd29-4e51-4d11-a5ef-69c16333e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.247851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41848276873a486c97913412ce43bf60', 'request_id': 'req-d6469767-a4b2-40ca-9a1a-25a7124a0678'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:40.264580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 879/1768] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:40.265558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404bd29-4e51-4d11-a5ef-69c16333e670 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:40.267033 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2404bd29-4e51-4d11-a5ef-69c16333e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.280214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:40.302762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41848276873a486c97913412ce43bf60', 'request_id': 'req-d6469767-a4b2-40ca-9a1a-25a7124a0678'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:40.441858 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41848276873a486c97913412ce43bf60', 'request_id': 'req-d6469767-a4b2-40ca-9a1a-25a7124a0678'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:40.462798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404bd29-4e51-4d11-a5ef-69c16333e670 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:40.480279 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] The token cache is being invalidate because project 41848276873a486c97913412ce43bf60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:40.482165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:40.486588 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:40.497909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 890/1769] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:39 2022] DELETE /identity/v3/projects/41848276873a486c97913412ce43bf60 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:40.508426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:40.514953 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.713804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6469767-a4b2-40ca-9a1a-25a7124a0678 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:40.721406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12537f-5376-435d-bb4d-7e6e5865c6d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:40.727124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12537f-5376-435d-bb4d-7e6e5865c6d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:40.727967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12537f-5376-435d-bb4d-7e6e5865c6d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:40.728257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12537f-5376-435d-bb4d-7e6e5865c6d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:40.739393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7b12537f-5376-435d-bb4d-7e6e5865c6d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.741885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd482f-116e-4065-9dad-f23793436b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:40.743354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd482f-116e-4065-9dad-f23793436b0a service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:40.743727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd482f-116e-4065-9dad-f23793436b0a service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:40.744048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd482f-116e-4065-9dad-f23793436b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:40.756745 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-45dd482f-116e-4065-9dad-f23793436b0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.834622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd482f-116e-4065-9dad-f23793436b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:40.869410 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd482f-116e-4065-9dad-f23793436b0a service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:40.916079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 880/1770] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:40.917873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc6f0d-e7bb-4934-b43b-8652a4fd13dd None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:40.918414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc6f0d-e7bb-4934-b43b-8652a4fd13dd None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:40.919260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc6f0d-e7bb-4934-b43b-8652a4fd13dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:40.933581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12537f-5376-435d-bb4d-7e6e5865c6d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:40.935972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12537f-5376-435d-bb4d-7e6e5865c6d6 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:40.959730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 891/1771] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:40.984178 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e9fc6f0d-e7bb-4934-b43b-8652a4fd13dd None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:40.985439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e9fc6f0d-e7bb-4934-b43b-8652a4fd13dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:41.219233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 881/1772] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:41.224798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e144a-81a5-404d-9631-bfe6fd0b74b9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:41.225218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e144a-81a5-404d-9631-bfe6fd0b74b9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:41.225635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e144a-81a5-404d-9631-bfe6fd0b74b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:41.324196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-343e144a-81a5-404d-9631-bfe6fd0b74b9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:41.345151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-343e144a-81a5-404d-9631-bfe6fd0b74b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:41.375244 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 892/1773] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:41.380635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc6f0d-e7bb-4934-b43b-8652a4fd13dd None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:41.392648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc6f0d-e7bb-4934-b43b-8652a4fd13dd None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:41.406184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e6234-b404-4f4c-822e-880c4c2d7d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:41.407008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e6234-b404-4f4c-822e-880c4c2d7d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:41.407237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e6234-b404-4f4c-822e-880c4c2d7d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:41.407520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e6234-b404-4f4c-822e-880c4c2d7d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:41.408243 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e6234-b404-4f4c-822e-880c4c2d7d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:41.408551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e6234-b404-4f4c-822e-880c4c2d7d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:41.414782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e6234-b404-4f4c-822e-880c4c2d7d53 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:41.471287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 882/1774] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:41.476042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e144a-81a5-404d-9631-bfe6fd0b74b9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:41.500489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e144a-81a5-404d-9631-bfe6fd0b74b9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:41.526093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77344a37-413d-4fa1-a5ca-6e38cd65d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:41.526769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77344a37-413d-4fa1-a5ca-6e38cd65d024 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:41.527053 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77344a37-413d-4fa1-a5ca-6e38cd65d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:41.527329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77344a37-413d-4fa1-a5ca-6e38cd65d024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:41.528025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77344a37-413d-4fa1-a5ca-6e38cd65d024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:41.530151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77344a37-413d-4fa1-a5ca-6e38cd65d024 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:41.536722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d385-4b5d-43db-8295-26444f9ae5c4 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:41.537450 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d385-4b5d-43db-8295-26444f9ae5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:41.538145 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d385-4b5d-43db-8295-26444f9ae5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:41.607248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-b545d385-4b5d-43db-8295-26444f9ae5c4 None None] MFA Rules not processed for user `23cfeac2a23e4f82a2d515db5c46ab6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:41.614553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b545d385-4b5d-43db-8295-26444f9ae5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:41.760391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 893/1775] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:41 2022] POST /identity/v3/projects => generated 361 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:41.770571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77344a37-413d-4fa1-a5ca-6e38cd65d024 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:41.779797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:41.891502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 883/1776] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:41.959304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77344a37-413d-4fa1-a5ca-6e38cd65d024 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:41.976078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c7311-2e44-489d-a406-9a1b5013cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:41.979455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c7311-2e44-489d-a406-9a1b5013cf03 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:41.980168 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c7311-2e44-489d-a406-9a1b5013cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:41.983104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c7311-2e44-489d-a406-9a1b5013cf03 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:41.983863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c7311-2e44-489d-a406-9a1b5013cf03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:41.995783 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c7311-2e44-489d-a406-9a1b5013cf03 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:42.118180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 894/1777] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:41 2022] POST /identity/v3/users => generated 281 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:42.119489 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545d385-4b5d-43db-8295-26444f9ae5c4 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:42.145182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545d385-4b5d-43db-8295-26444f9ae5c4 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:42.155603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810244b-ddf3-426d-b65b-cfe9d3cd0fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:42.156637 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810244b-ddf3-426d-b65b-cfe9d3cd0fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:42.157048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810244b-ddf3-426d-b65b-cfe9d3cd0fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:42.157492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810244b-ddf3-426d-b65b-cfe9d3cd0fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:42.158351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810244b-ddf3-426d-b65b-cfe9d3cd0fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:42.160689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810244b-ddf3-426d-b65b-cfe9d3cd0fd1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:42.179616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 884/1778] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:42.184975 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c7311-2e44-489d-a406-9a1b5013cf03 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:42.212815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c7311-2e44-489d-a406-9a1b5013cf03 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:42.233026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4f6fc-dc89-478d-afc0-0123f82af1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:42.236317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4f6fc-dc89-478d-afc0-0123f82af1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:42.239692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4f6fc-dc89-478d-afc0-0123f82af1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:42.239692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4f6fc-dc89-478d-afc0-0123f82af1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:42.239692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4f6fc-dc89-478d-afc0-0123f82af1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:42.243881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4f6fc-dc89-478d-afc0-0123f82af1b5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:42.261389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 895/1779] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:42.266023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810244b-ddf3-426d-b65b-cfe9d3cd0fd1 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:42.286238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810244b-ddf3-426d-b65b-cfe9d3cd0fd1 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:42.311553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab218be8-9070-4f70-867d-989e91ffa284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:42.317976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218be8-9070-4f70-867d-989e91ffa284 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:42.322688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218be8-9070-4f70-867d-989e91ffa284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:42.326627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218be8-9070-4f70-867d-989e91ffa284 admin admin] PATH_INFO: `/v3/projects/e13b03515430446aa3b31134d0f3a67f/users/6549482f033e4cc393bf8bde3014818e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:42.367388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab218be8-9070-4f70-867d-989e91ffa284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13b03515430446aa3b31134d0f3a67f, user_id=6549482f033e4cc393bf8bde3014818e, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:42.370370 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab218be8-9070-4f70-867d-989e91ffa284 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:42.493858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 885/1780] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:42 2022] PUT /identity/v3/projects/e13b03515430446aa3b31134d0f3a67f/users/6549482f033e4cc393bf8bde3014818e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:42.512845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d95dc-073c-43b2-abfa-705843c48720 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:42.513295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d95dc-073c-43b2-abfa-705843c48720 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:42.513393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d95dc-073c-43b2-abfa-705843c48720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:42.599525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c67d95dc-073c-43b2-abfa-705843c48720 None None] MFA Rules not processed for user `6549482f033e4cc393bf8bde3014818e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:42.601124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c67d95dc-073c-43b2-abfa-705843c48720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:42.877762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 896/1781] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:42.883165 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab218be8-9070-4f70-867d-989e91ffa284 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.087807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab218be8-9070-4f70-867d-989e91ffa284 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.107189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b566c22-e850-42c2-a776-2fcbbf976eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.109268 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566c22-e850-42c2-a776-2fcbbf976eca admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.110006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566c22-e850-42c2-a776-2fcbbf976eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.110594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566c22-e850-42c2-a776-2fcbbf976eca admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.115807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b566c22-e850-42c2-a776-2fcbbf976eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.115807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b566c22-e850-42c2-a776-2fcbbf976eca admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.275529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 886/1782] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:42 2022] POST /identity/v3/projects => generated 363 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:43.279866 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d95dc-073c-43b2-abfa-705843c48720 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.302113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d95dc-073c-43b2-abfa-705843c48720 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.386237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5315-3e2b-41e3-ac5d-5b2046bd5834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.387240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5315-3e2b-41e3-ac5d-5b2046bd5834 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.387818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5315-3e2b-41e3-ac5d-5b2046bd5834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.388352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5315-3e2b-41e3-ac5d-5b2046bd5834 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.389550 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b5315-3e2b-41e3-ac5d-5b2046bd5834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.393884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b5315-3e2b-41e3-ac5d-5b2046bd5834 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.508238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 897/1783] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:43 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:43.511719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b566c22-e850-42c2-a776-2fcbbf976eca admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.535446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b566c22-e850-42c2-a776-2fcbbf976eca admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.543134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289d0ee-9edb-40db-8bb0-4c470f358a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.543441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289d0ee-9edb-40db-8bb0-4c470f358a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.543877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289d0ee-9edb-40db-8bb0-4c470f358a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.544197 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289d0ee-9edb-40db-8bb0-4c470f358a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.545905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289d0ee-9edb-40db-8bb0-4c470f358a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.548018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289d0ee-9edb-40db-8bb0-4c470f358a3c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.572834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 887/1784] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:43.577129 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5315-3e2b-41e3-ac5d-5b2046bd5834 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.596294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5315-3e2b-41e3-ac5d-5b2046bd5834 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.602776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623fd3-94f9-4714-99ca-f663a5027da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.607458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623fd3-94f9-4714-99ca-f663a5027da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.607458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623fd3-94f9-4714-99ca-f663a5027da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.607458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623fd3-94f9-4714-99ca-f663a5027da0 admin admin] PATH_INFO: `/v3/projects/2fcfc959695c44ee8cd5db41caf351c0/users/4b3a0f8e03ec4d559e555c9560f6045d/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.629535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d623fd3-94f9-4714-99ca-f663a5027da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcfc959695c44ee8cd5db41caf351c0, user_id=4b3a0f8e03ec4d559e555c9560f6045d, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.633334 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d623fd3-94f9-4714-99ca-f663a5027da0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.762906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 898/1785] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:43 2022] PUT /identity/v3/projects/2fcfc959695c44ee8cd5db41caf351c0/users/4b3a0f8e03ec4d559e555c9560f6045d/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:43.767073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289d0ee-9edb-40db-8bb0-4c470f358a3c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.785263 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289d0ee-9edb-40db-8bb0-4c470f358a3c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.960664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634474b-6dfa-4876-8c8c-45846d905892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.961538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634474b-6dfa-4876-8c8c-45846d905892 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.962129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634474b-6dfa-4876-8c8c-45846d905892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.962795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634474b-6dfa-4876-8c8c-45846d905892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.963616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634474b-6dfa-4876-8c8c-45846d905892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.966419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634474b-6dfa-4876-8c8c-45846d905892 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.985008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623fd3-94f9-4714-99ca-f663a5027da0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.986818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 888/1786] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:43.999459 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623fd3-94f9-4714-99ca-f663a5027da0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.013243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a08e8-55e9-4d03-8e6f-3156c5b9067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.014534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a08e8-55e9-4d03-8e6f-3156c5b9067b admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.015119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a08e8-55e9-4d03-8e6f-3156c5b9067b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.015711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a08e8-55e9-4d03-8e6f-3156c5b9067b admin admin] PATH_INFO: `/v3/projects/2fcfc959695c44ee8cd5db41caf351c0/users/4b3a0f8e03ec4d559e555c9560f6045d/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.020083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a08e8-55e9-4d03-8e6f-3156c5b9067b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcfc959695c44ee8cd5db41caf351c0, user_id=4b3a0f8e03ec4d559e555c9560f6045d, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.022979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a08e8-55e9-4d03-8e6f-3156c5b9067b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.045274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 899/1787] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:43 2022] PUT /identity/v3/projects/2fcfc959695c44ee8cd5db41caf351c0/users/4b3a0f8e03ec4d559e555c9560f6045d/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:44.056172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba90d3c-577e-4b20-8dc3-ccecbf46b75f None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.056766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba90d3c-577e-4b20-8dc3-ccecbf46b75f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.057238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba90d3c-577e-4b20-8dc3-ccecbf46b75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.137245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7ba90d3c-577e-4b20-8dc3-ccecbf46b75f None None] MFA Rules not processed for user `4b3a0f8e03ec4d559e555c9560f6045d`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:44.138526 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7ba90d3c-577e-4b20-8dc3-ccecbf46b75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:44.245850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:44.333986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:44.358894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 889/1788] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:44.369029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a08e8-55e9-4d03-8e6f-3156c5b9067b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.371132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-026a08e8-55e9-4d03-8e6f-3156c5b9067b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:44.544934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a08e8-55e9-4d03-8e6f-3156c5b9067b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.555702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745bbb0-f27c-4422-8994-33bba283066c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.556599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745bbb0-f27c-4422-8994-33bba283066c service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.557043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745bbb0-f27c-4422-8994-33bba283066c service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.557490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745bbb0-f27c-4422-8994-33bba283066c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.587912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745bbb0-f27c-4422-8994-33bba283066c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.595237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745bbb0-f27c-4422-8994-33bba283066c service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.643601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 900/1789] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:45.433988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba90d3c-577e-4b20-8dc3-ccecbf46b75f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.447635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba90d3c-577e-4b20-8dc3-ccecbf46b75f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.452641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16bcf-7b19-488f-b5af-cd042743db68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.453402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16bcf-7b19-488f-b5af-cd042743db68 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.453788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16bcf-7b19-488f-b5af-cd042743db68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.454165 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16bcf-7b19-488f-b5af-cd042743db68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.659857 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce16bcf-7b19-488f-b5af-cd042743db68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.661312 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce16bcf-7b19-488f-b5af-cd042743db68 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.699171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 890/1790] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:46.499479 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:46.613593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:48.798619 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed35ddc-6d03-456f-a04d-c77a6c85712f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:48.799603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed35ddc-6d03-456f-a04d-c77a6c85712f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:48.799885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed35ddc-6d03-456f-a04d-c77a6c85712f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:48.801888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 901/1791] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:47:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:48.975798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6675-95d5-471f-a51b-69405d574a25 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:48.976874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6675-95d5-471f-a51b-69405d574a25 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:48.977377 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6675-95d5-471f-a51b-69405d574a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:49.020120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-de9b6675-95d5-471f-a51b-69405d574a25 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:49.021819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-de9b6675-95d5-471f-a51b-69405d574a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:49.167855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:49.178833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 891/1792] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:47:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:49.236499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed35ddc-6d03-456f-a04d-c77a6c85712f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:49.239214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9ed35ddc-6d03-456f-a04d-c77a6c85712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:49.290154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed35ddc-6d03-456f-a04d-c77a6c85712f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:49.303964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfda31-2b75-44f2-ad0f-a0734c4c0476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:49.311562 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfda31-2b75-44f2-ad0f-a0734c4c0476 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:49.315864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfda31-2b75-44f2-ad0f-a0734c4c0476 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:49.315864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfda31-2b75-44f2-ad0f-a0734c4c0476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:49.341721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfda31-2b75-44f2-ad0f-a0734c4c0476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:49.353205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfda31-2b75-44f2-ad0f-a0734c4c0476 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:49.368148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 902/1793] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:50.227674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:51.671816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b6675-95d5-471f-a51b-69405d574a25 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:51.673358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-de9b6675-95d5-471f-a51b-69405d574a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:51.849736 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66995-34a4-4f37-908c-71332d9a3565 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:51.853924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66995-34a4-4f37-908c-71332d9a3565 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:51.853924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66995-34a4-4f37-908c-71332d9a3565 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:51.853924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 903/1794] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:47:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:51.873363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b6675-95d5-471f-a51b-69405d574a25 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:51.913117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:51.915052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:51.915682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:51.916110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] PATH_INFO: `/v3/users/87da8c29b01348a598853ada9a9fd964` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:51.918661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f1eef-686a-49cf-99b8-678978e1e360 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:51.919123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f1eef-686a-49cf-99b8-678978e1e360 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:51.919543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f1eef-686a-49cf-99b8-678978e1e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:51.926605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87da8c29b01348a598853ada9a9fd964)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:51.943674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:51.989447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-af6f1eef-686a-49cf-99b8-678978e1e360 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:51.994652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-af6f1eef-686a-49cf-99b8-678978e1e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:52.022121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 904/1795] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:47:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:52.238768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87da8c29b01348a598853ada9a9fd964'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.255915 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87da8c29b01348a598853ada9a9fd964'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.420648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f1eef-686a-49cf-99b8-678978e1e360 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:52.427997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87da8c29b01348a598853ada9a9fd964'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.428126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-af6f1eef-686a-49cf-99b8-678978e1e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:52.435879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87da8c29b01348a598853ada9a9fd964'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.436728 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e8fa424d-c8e9-494c-b829-186455e05c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87da8c29b01348a598853ada9a9fd964'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.451051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 892/1796] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:51 2022] DELETE /identity/v3/users/87da8c29b01348a598853ada9a9fd964 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:52.452085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f1eef-686a-49cf-99b8-678978e1e360 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:52.457265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32591f-a664-4224-9a05-782bf7e45b94 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:52.457548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32591f-a664-4224-9a05-782bf7e45b94 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:52.460714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32591f-a664-4224-9a05-782bf7e45b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:52.523060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-df32591f-a664-4224-9a05-782bf7e45b94 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:52.524317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-df32591f-a664-4224-9a05-782bf7e45b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:52.595509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa876e6b-b664-4c1f-8222-2dba82fcc33d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:52.596154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876e6b-b664-4c1f-8222-2dba82fcc33d service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:52.596496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876e6b-b664-4c1f-8222-2dba82fcc33d service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:52.596837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876e6b-b664-4c1f-8222-2dba82fcc33d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:52.599917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fa876e6b-b664-4c1f-8222-2dba82fcc33d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:52.618839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa876e6b-b664-4c1f-8222-2dba82fcc33d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:52.620904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa876e6b-b664-4c1f-8222-2dba82fcc33d service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:52.627759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 893/1797] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:52.642592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 905/1798] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:52.729445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32591f-a664-4224-9a05-782bf7e45b94 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:52.731090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-df32591f-a664-4224-9a05-782bf7e45b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:52.825420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32591f-a664-4224-9a05-782bf7e45b94 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:52.832566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0f9da-6fd8-4dce-afcc-4971c5907a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:52.836566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f9da-6fd8-4dce-afcc-4971c5907a9a service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:52.836566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f9da-6fd8-4dce-afcc-4971c5907a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:52.836566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f9da-6fd8-4dce-afcc-4971c5907a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:52.845248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0f9da-6fd8-4dce-afcc-4971c5907a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:52.855685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0f9da-6fd8-4dce-afcc-4971c5907a9a service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:52.868312 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 894/1799] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:53.231664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:53.470871 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:54.168573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:54.388229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa876e6b-b664-4c1f-8222-2dba82fcc33d service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:54.389844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fa876e6b-b664-4c1f-8222-2dba82fcc33d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:54.405925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa876e6b-b664-4c1f-8222-2dba82fcc33d service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:54.413145 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:54.414633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:54.415352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:54.415774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] PATH_INFO: `/v3/projects/4f66f44382ca4ea88ecfcca2221f28a5` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:54.417769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f66f44382ca4ea88ecfcca2221f28a5)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:54.419975 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:54.591183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f66f44382ca4ea88ecfcca2221f28a5', 'request_id': 'req-9cff23c3-326c-4b29-9243-922cbc5d4ae8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:54.597557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f66f44382ca4ea88ecfcca2221f28a5', 'request_id': 'req-9cff23c3-326c-4b29-9243-922cbc5d4ae8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:54.739593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f66f44382ca4ea88ecfcca2221f28a5', 'request_id': 'req-9cff23c3-326c-4b29-9243-922cbc5d4ae8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:54.751041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] The token cache is being invalidate because project 4f66f44382ca4ea88ecfcca2221f28a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:54.751333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:54.751988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:54.753704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 906/1800] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:54 2022] DELETE /identity/v3/projects/4f66f44382ca4ea88ecfcca2221f28a5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:54.757783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0f9da-6fd8-4dce-afcc-4971c5907a9a service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:54.769125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0f9da-6fd8-4dce-afcc-4971c5907a9a service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:54.837833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:54.838553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:54.838789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:54.839061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] PATH_INFO: `/v3/users/5d196c5fbd9c4f1b997f4ab52caccf2d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:54.840190 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d196c5fbd9c4f1b997f4ab52caccf2d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:54.846246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:55.074996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d196c5fbd9c4f1b997f4ab52caccf2d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:55.088329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d196c5fbd9c4f1b997f4ab52caccf2d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:55.196961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d196c5fbd9c4f1b997f4ab52caccf2d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:55.205829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d196c5fbd9c4f1b997f4ab52caccf2d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:55.206615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-23e0a55f-9b8f-4a54-8217-df7e83f94439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d196c5fbd9c4f1b997f4ab52caccf2d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:55.213947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 895/1801] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:54 2022] DELETE /identity/v3/users/5d196c5fbd9c4f1b997f4ab52caccf2d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:55.444590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:55.838853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:55.841118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:55.855998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff23c3-326c-4b29-9243-922cbc5d4ae8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:56.032107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:56.032766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.033056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.033338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] PATH_INFO: `/v3/projects/fd704aa3d2114c279f390397e0d97057` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.034685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd704aa3d2114c279f390397e0d97057)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:56.036746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:56.157057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd704aa3d2114c279f390397e0d97057', 'request_id': 'req-6059fa5c-9ebf-4a67-823e-99108de839b7'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:56.163291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd704aa3d2114c279f390397e0d97057', 'request_id': 'req-6059fa5c-9ebf-4a67-823e-99108de839b7'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:56.173493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:56.236004 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd704aa3d2114c279f390397e0d97057', 'request_id': 'req-6059fa5c-9ebf-4a67-823e-99108de839b7'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:56.246959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] The token cache is being invalidate because project fd704aa3d2114c279f390397e0d97057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:56.247253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:56.250375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6059fa5c-9ebf-4a67-823e-99108de839b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:56.250375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 907/1802] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:55 2022] DELETE /identity/v3/projects/fd704aa3d2114c279f390397e0d97057 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:56.254444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e61661-e4a2-4923-81df-50efcdbeeaa6 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.254899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e61661-e4a2-4923-81df-50efcdbeeaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.255048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e61661-e4a2-4923-81df-50efcdbeeaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.276573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-f9e61661-e4a2-4923-81df-50efcdbeeaa6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:56.277850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f9e61661-e4a2-4923-81df-50efcdbeeaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:56.352213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 896/1803] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:56.359792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64397ce4-548f-46f5-a266-c66b3e0af7d5 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.364581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64397ce4-548f-46f5-a266-c66b3e0af7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.364581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64397ce4-548f-46f5-a266-c66b3e0af7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.384475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-64397ce4-548f-46f5-a266-c66b3e0af7d5 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:56.386683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-64397ce4-548f-46f5-a266-c66b3e0af7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:56.398936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 908/1804] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:56.403414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e61661-e4a2-4923-81df-50efcdbeeaa6 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:56.415119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e61661-e4a2-4923-81df-50efcdbeeaa6 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:56.419867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934498ba-ecb5-4db0-9d20-3b545d14ed1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:56.420770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934498ba-ecb5-4db0-9d20-3b545d14ed1e admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.421057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934498ba-ecb5-4db0-9d20-3b545d14ed1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.421337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934498ba-ecb5-4db0-9d20-3b545d14ed1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.421987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934498ba-ecb5-4db0-9d20-3b545d14ed1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:56.422505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934498ba-ecb5-4db0-9d20-3b545d14ed1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:56.424342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934498ba-ecb5-4db0-9d20-3b545d14ed1e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:56.437009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 897/1805] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:56.441423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64397ce4-548f-46f5-a266-c66b3e0af7d5 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:56.452343 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64397ce4-548f-46f5-a266-c66b3e0af7d5 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:56.457467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ab157-12f2-4fd2-9270-ac7b4e7e44e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:56.458157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab157-12f2-4fd2-9270-ac7b4e7e44e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.458680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab157-12f2-4fd2-9270-ac7b4e7e44e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.459041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab157-12f2-4fd2-9270-ac7b4e7e44e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.459748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ab157-12f2-4fd2-9270-ac7b4e7e44e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:56.462428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ab157-12f2-4fd2-9270-ac7b4e7e44e0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:56.594841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 909/1806] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:56 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:56.597133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934498ba-ecb5-4db0-9d20-3b545d14ed1e admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:56.617072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934498ba-ecb5-4db0-9d20-3b545d14ed1e admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:56.703493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a7b25-425b-416c-b494-73f942b8faee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:56.703493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7b25-425b-416c-b494-73f942b8faee admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.703493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7b25-425b-416c-b494-73f942b8faee admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.703493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7b25-425b-416c-b494-73f942b8faee admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.708574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a7b25-425b-416c-b494-73f942b8faee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:56.711824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a7b25-425b-416c-b494-73f942b8faee admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:56.952389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 898/1807] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:56 2022] POST /identity/v3/users => generated 288 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:56.956313 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ab157-12f2-4fd2-9270-ac7b4e7e44e0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:56.967060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ab157-12f2-4fd2-9270-ac7b4e7e44e0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:56.972009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9053770-fd2a-4d2d-bbaf-a6d17fea8663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:56.973308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9053770-fd2a-4d2d-bbaf-a6d17fea8663 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.973591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9053770-fd2a-4d2d-bbaf-a6d17fea8663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.973865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9053770-fd2a-4d2d-bbaf-a6d17fea8663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.974587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9053770-fd2a-4d2d-bbaf-a6d17fea8663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:56.976541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9053770-fd2a-4d2d-bbaf-a6d17fea8663 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:56.986718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 910/1808] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:56.995182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a7b25-425b-416c-b494-73f942b8faee admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:57.005018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a7b25-425b-416c-b494-73f942b8faee admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:57.010523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2773b6-b584-46ea-b3f1-2c3c2c6b5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:57.011134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2773b6-b584-46ea-b3f1-2c3c2c6b5ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:57.011420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2773b6-b584-46ea-b3f1-2c3c2c6b5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:57.011691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2773b6-b584-46ea-b3f1-2c3c2c6b5ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:57.012501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2773b6-b584-46ea-b3f1-2c3c2c6b5ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:57.014367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2773b6-b584-46ea-b3f1-2c3c2c6b5ec0 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:57.026739 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 899/1809] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:57.033542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9053770-fd2a-4d2d-bbaf-a6d17fea8663 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:57.043798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9053770-fd2a-4d2d-bbaf-a6d17fea8663 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:57.048550 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44429fd-1399-4e85-b415-9549e6e0a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:57.049214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44429fd-1399-4e85-b415-9549e6e0a5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:57.049552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44429fd-1399-4e85-b415-9549e6e0a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:57.049893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44429fd-1399-4e85-b415-9549e6e0a5d1 admin admin] PATH_INFO: `/v3/projects/59b3d4ea982344d68cfd3501e365ef6f/users/d8fbedb63d2547ebb991b6a59defaa9a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:57.075276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44429fd-1399-4e85-b415-9549e6e0a5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b3d4ea982344d68cfd3501e365ef6f, user_id=d8fbedb63d2547ebb991b6a59defaa9a, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:57.078303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44429fd-1399-4e85-b415-9549e6e0a5d1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:57.212744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 911/1810] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:57 2022] PUT /identity/v3/projects/59b3d4ea982344d68cfd3501e365ef6f/users/d8fbedb63d2547ebb991b6a59defaa9a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:57.214322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7c5b-9502-4a83-bf05-95ecbda55996 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:57.214628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7c5b-9502-4a83-bf05-95ecbda55996 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:57.215463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7c5b-9502-4a83-bf05-95ecbda55996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:57.248593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-52aa7c5b-9502-4a83-bf05-95ecbda55996 None None] MFA Rules not processed for user `d8fbedb63d2547ebb991b6a59defaa9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:57.250032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-52aa7c5b-9502-4a83-bf05-95ecbda55996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:57.337036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 900/1811] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:57.354740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44429fd-1399-4e85-b415-9549e6e0a5d1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:57.362722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f44429fd-1399-4e85-b415-9549e6e0a5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:57.455555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44429fd-1399-4e85-b415-9549e6e0a5d1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:57.460695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8ae4f-893f-44d8-8ba7-9c275c011233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:57.471169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ae4f-893f-44d8-8ba7-9c275c011233 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:57.471169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ae4f-893f-44d8-8ba7-9c275c011233 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:57.471169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ae4f-893f-44d8-8ba7-9c275c011233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:57.476784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8ae4f-893f-44d8-8ba7-9c275c011233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:57.479840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8ae4f-893f-44d8-8ba7-9c275c011233 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:57.507970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 912/1812] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:58.195073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7c5b-9502-4a83-bf05-95ecbda55996 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:58.197659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-52aa7c5b-9502-4a83-bf05-95ecbda55996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:58.298505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7c5b-9502-4a83-bf05-95ecbda55996 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:58.303093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:58.303732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:58.304038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:58.305016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] PATH_INFO: `/v3/users/12ec1542d64d4a9bb4ffa958ac719033` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:58.306551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ec1542d64d4a9bb4ffa958ac719033)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:58.308641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:58.614731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ec1542d64d4a9bb4ffa958ac719033'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:58.629547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ec1542d64d4a9bb4ffa958ac719033'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:58.824580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ec1542d64d4a9bb4ffa958ac719033'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:58.833788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ec1542d64d4a9bb4ffa958ac719033'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:58.834631 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ec1542d64d4a9bb4ffa958ac719033'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:58.843327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 901/1813] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:58 2022] DELETE /identity/v3/users/12ec1542d64d4a9bb4ffa958ac719033 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:58.847809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0404f64-04bd-412f-b3f6-cf00c14d6197 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:58.848646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0404f64-04bd-412f-b3f6-cf00c14d6197 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:58.849381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0404f64-04bd-412f-b3f6-cf00c14d6197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:58.873103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d0404f64-04bd-412f-b3f6-cf00c14d6197 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:58.874446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d0404f64-04bd-412f-b3f6-cf00c14d6197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:58.938179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 913/1814] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:58.964042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:58.965537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:59.025054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00282-4ae3-42ea-81d7-2a15b267ad76 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:59.028900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40b08f-5a74-440c-bada-2bb1d9deec6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:59.035274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40b08f-5a74-440c-bada-2bb1d9deec6b service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:59.035783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40b08f-5a74-440c-bada-2bb1d9deec6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:59.036211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40b08f-5a74-440c-bada-2bb1d9deec6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:59.052357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40b08f-5a74-440c-bada-2bb1d9deec6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:59.054871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40b08f-5a74-440c-bada-2bb1d9deec6b service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:59.076568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 902/1815] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:59.287789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0404f64-04bd-412f-b3f6-cf00c14d6197 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:59.290335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d0404f64-04bd-412f-b3f6-cf00c14d6197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:59.324298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0404f64-04bd-412f-b3f6-cf00c14d6197 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:59.331692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:59.332976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:59.333363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:59.333784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] PATH_INFO: `/v3/users/6549482f033e4cc393bf8bde3014818e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:59.335153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6549482f033e4cc393bf8bde3014818e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:59.337705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:59.609251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6549482f033e4cc393bf8bde3014818e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:59.610218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6549482f033e4cc393bf8bde3014818e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:59.635439 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6549482f033e4cc393bf8bde3014818e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:59.659298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6549482f033e4cc393bf8bde3014818e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:59.671280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:59.785005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6549482f033e4cc393bf8bde3014818e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:59.792050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 914/1816] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:59 2022] DELETE /identity/v3/users/6549482f033e4cc393bf8bde3014818e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:59.797928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfae555-e8d5-47fc-9ffd-650deaf9b9e6 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:59.798252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfae555-e8d5-47fc-9ffd-650deaf9b9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:59.798600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfae555-e8d5-47fc-9ffd-650deaf9b9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:59.835813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5cfae555-e8d5-47fc-9ffd-650deaf9b9e6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:59.838096 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5cfae555-e8d5-47fc-9ffd-650deaf9b9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:59.916296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 903/1817] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:59.932157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:59.934297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:00.009783 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fe82a-7916-4768-a9df-937077bc5932 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.017132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c6c87-4226-4bec-bbd2-6d252bdd5328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.018222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c6c87-4226-4bec-bbd2-6d252bdd5328 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.025293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c6c87-4226-4bec-bbd2-6d252bdd5328 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.025293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c6c87-4226-4bec-bbd2-6d252bdd5328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.031199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c6c87-4226-4bec-bbd2-6d252bdd5328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.032723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c6c87-4226-4bec-bbd2-6d252bdd5328 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.043665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 915/1818] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:00.216487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfae555-e8d5-47fc-9ffd-650deaf9b9e6 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.218325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5cfae555-e8d5-47fc-9ffd-650deaf9b9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:00.242518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfae555-e8d5-47fc-9ffd-650deaf9b9e6 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.255789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.256861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.258547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.259014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] PATH_INFO: `/v3/projects/cb448cae2bef43fe8236e221c50d911e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.260803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb448cae2bef43fe8236e221c50d911e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.268204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.467653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb448cae2bef43fe8236e221c50d911e', 'request_id': 'req-cbd68b32-a686-4120-b1db-103bfd2c5ec2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:00.609069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb448cae2bef43fe8236e221c50d911e', 'request_id': 'req-cbd68b32-a686-4120-b1db-103bfd2c5ec2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:00.615358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb448cae2bef43fe8236e221c50d911e', 'request_id': 'req-cbd68b32-a686-4120-b1db-103bfd2c5ec2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:00.628802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] The token cache is being invalidate because project cb448cae2bef43fe8236e221c50d911e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:00.629107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:00.629761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cbd68b32-a686-4120-b1db-103bfd2c5ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:00.635404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 904/1819] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:00 2022] DELETE /identity/v3/projects/cb448cae2bef43fe8236e221c50d911e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:00.638106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d72b2-91b7-41f2-a8de-f631bc2d958c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.639064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d72b2-91b7-41f2-a8de-f631bc2d958c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.639510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d72b2-91b7-41f2-a8de-f631bc2d958c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.659039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-228d72b2-91b7-41f2-a8de-f631bc2d958c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:00.660311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-228d72b2-91b7-41f2-a8de-f631bc2d958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:00.729613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 916/1820] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:00.738656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9157-d53b-46a6-92d7-a9b94bdec7d3 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.739154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9157-d53b-46a6-92d7-a9b94bdec7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.739271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9157-d53b-46a6-92d7-a9b94bdec7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.760807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-362d9157-d53b-46a6-92d7-a9b94bdec7d3 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:00.763000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-362d9157-d53b-46a6-92d7-a9b94bdec7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:00.774363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 905/1821] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:00.778836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d72b2-91b7-41f2-a8de-f631bc2d958c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.790163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d72b2-91b7-41f2-a8de-f631bc2d958c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.795213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f1394-2513-40e5-8413-eb39ce108952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.795803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f1394-2513-40e5-8413-eb39ce108952 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.796100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f1394-2513-40e5-8413-eb39ce108952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.796488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f1394-2513-40e5-8413-eb39ce108952 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.797134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f1394-2513-40e5-8413-eb39ce108952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:00.797445 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f1394-2513-40e5-8413-eb39ce108952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.799067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f1394-2513-40e5-8413-eb39ce108952 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.813143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 917/1822] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:00.816817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d9157-d53b-46a6-92d7-a9b94bdec7d3 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.818083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f1394-2513-40e5-8413-eb39ce108952 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.819354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-362d9157-d53b-46a6-92d7-a9b94bdec7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:00.835794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d9157-d53b-46a6-92d7-a9b94bdec7d3 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.841225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.842113 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.842642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f1394-2513-40e5-8413-eb39ce108952 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.842776 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.843164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] PATH_INFO: `/v3/projects/e13b03515430446aa3b31134d0f3a67f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.844496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13b03515430446aa3b31134d0f3a67f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.847562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.871442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74d91e-366b-49ae-9be0-c30a12a17f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.872084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74d91e-366b-49ae-9be0-c30a12a17f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.872383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74d91e-366b-49ae-9be0-c30a12a17f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.872948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74d91e-366b-49ae-9be0-c30a12a17f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.874083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74d91e-366b-49ae-9be0-c30a12a17f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.876590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74d91e-366b-49ae-9be0-c30a12a17f34 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.009053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13b03515430446aa3b31134d0f3a67f', 'request_id': 'req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.049749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 918/1823] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:00 2022] POST /identity/v3/projects => generated 403 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:01.053307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74d91e-366b-49ae-9be0-c30a12a17f34 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:01.110498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13b03515430446aa3b31134d0f3a67f', 'request_id': 'req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.117761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13b03515430446aa3b31134d0f3a67f', 'request_id': 'req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.125458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74d91e-366b-49ae-9be0-c30a12a17f34 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:01.129476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] The token cache is being invalidate because project e13b03515430446aa3b31134d0f3a67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:01.130054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.130657 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dfc4e-131d-4ebc-9bc9-13fdfb0a9820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:01.131275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dfc4e-131d-4ebc-9bc9-13fdfb0a9820 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.131583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dfc4e-131d-4ebc-9bc9-13fdfb0a9820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.132102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dfc4e-131d-4ebc-9bc9-13fdfb0a9820 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.132774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.133537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dfc4e-131d-4ebc-9bc9-13fdfb0a9820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:01.134448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 906/1824] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:00 2022] DELETE /identity/v3/projects/e13b03515430446aa3b31134d0f3a67f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:01.135723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dfc4e-131d-4ebc-9bc9-13fdfb0a9820 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.138233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:01.139896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:01.211844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86ffcf-cca3-42b3-bcaa-ae7f74996066 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:01.217959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:01.218625 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.218906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.219183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] PATH_INFO: `/v3/users/4b3a0f8e03ec4d559e555c9560f6045d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.220330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3a0f8e03ec4d559e555c9560f6045d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:01.222325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.224793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 919/1825] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:01 2022] POST /identity/v3/users => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:01.228307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dfc4e-131d-4ebc-9bc9-13fdfb0a9820 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:01.230052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-921dfc4e-131d-4ebc-9bc9-13fdfb0a9820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:01.243284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dfc4e-131d-4ebc-9bc9-13fdfb0a9820 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:01.248034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89377b-0d8f-4745-a66d-796d1f9c0140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:01.248648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89377b-0d8f-4745-a66d-796d1f9c0140 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.248930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89377b-0d8f-4745-a66d-796d1f9c0140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.249206 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89377b-0d8f-4745-a66d-796d1f9c0140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.249852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89377b-0d8f-4745-a66d-796d1f9c0140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:01.251494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89377b-0d8f-4745-a66d-796d1f9c0140 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.261982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 920/1826] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:01.266135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89377b-0d8f-4745-a66d-796d1f9c0140 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:01.277415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89377b-0d8f-4745-a66d-796d1f9c0140 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:01.283328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a36f8-c9fb-4747-842d-393955606cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:01.287547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a36f8-c9fb-4747-842d-393955606cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.287547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a36f8-c9fb-4747-842d-393955606cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.287547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a36f8-c9fb-4747-842d-393955606cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.287962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a36f8-c9fb-4747-842d-393955606cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:01.290303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a36f8-c9fb-4747-842d-393955606cb3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.304925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 921/1827] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:01.306793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a36f8-c9fb-4747-842d-393955606cb3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:01.318546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a36f8-c9fb-4747-842d-393955606cb3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:01.328703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc2aa2-4cdb-47b7-9235-3a071e9aae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:01.328703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc2aa2-4cdb-47b7-9235-3a071e9aae3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.328703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc2aa2-4cdb-47b7-9235-3a071e9aae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.328703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc2aa2-4cdb-47b7-9235-3a071e9aae3b admin admin] PATH_INFO: `/v3/projects/6eecdc5fe2164b9cad375a8894b583c0/users/a5f09196b93b4f4fb1e8a291660d60b1/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.346401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc2aa2-4cdb-47b7-9235-3a071e9aae3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eecdc5fe2164b9cad375a8894b583c0, user_id=a5f09196b93b4f4fb1e8a291660d60b1, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:01.349226 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc2aa2-4cdb-47b7-9235-3a071e9aae3b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.455477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 922/1828] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:01 2022] PUT /identity/v3/projects/6eecdc5fe2164b9cad375a8894b583c0/users/a5f09196b93b4f4fb1e8a291660d60b1/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:01.460818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6098e2d-34dd-4faa-bf5f-fa31e9ac7770 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.461112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6098e2d-34dd-4faa-bf5f-fa31e9ac7770 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.462270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6098e2d-34dd-4faa-bf5f-fa31e9ac7770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.488069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e6098e2d-34dd-4faa-bf5f-fa31e9ac7770 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:01.489670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e6098e2d-34dd-4faa-bf5f-fa31e9ac7770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:01.498158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3a0f8e03ec4d559e555c9560f6045d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.520223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3a0f8e03ec4d559e555c9560f6045d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.581768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 923/1829] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:01.589921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6098e2d-34dd-4faa-bf5f-fa31e9ac7770 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:01.592408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e6098e2d-34dd-4faa-bf5f-fa31e9ac7770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:01.597023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3a0f8e03ec4d559e555c9560f6045d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.614016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3a0f8e03ec4d559e555c9560f6045d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.615188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3a0f8e03ec4d559e555c9560f6045d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.626268 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 907/1830] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:01 2022] DELETE /identity/v3/users/4b3a0f8e03ec4d559e555c9560f6045d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:01.692042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6098e2d-34dd-4faa-bf5f-fa31e9ac7770 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:01.755231 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d24f3f-ce4a-46ff-bef8-4030f9760e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:01.755861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d24f3f-ce4a-46ff-bef8-4030f9760e82 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.756146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d24f3f-ce4a-46ff-bef8-4030f9760e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.756420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d24f3f-ce4a-46ff-bef8-4030f9760e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.758481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-24d24f3f-ce4a-46ff-bef8-4030f9760e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:01.831583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:01.868004 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d24f3f-ce4a-46ff-bef8-4030f9760e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:01.869488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d24f3f-ce4a-46ff-bef8-4030f9760e82 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.899701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 924/1831] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:02.278665 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:02.280375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:02.294215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74dad4-d23e-41d9-ae2e-ebfe662a8b0f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:02.307643 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:02.308705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:02.309214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:02.309732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] PATH_INFO: `/v3/projects/2fcfc959695c44ee8cd5db41caf351c0` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:02.311191 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcfc959695c44ee8cd5db41caf351c0)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:02.313822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:02.471519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:02.494604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcfc959695c44ee8cd5db41caf351c0', 'request_id': 'req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:02.579967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcfc959695c44ee8cd5db41caf351c0', 'request_id': 'req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:02.587248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcfc959695c44ee8cd5db41caf351c0', 'request_id': 'req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:02.600664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] The token cache is being invalidate because project 2fcfc959695c44ee8cd5db41caf351c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:02.601520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:02.602369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b4cf3c6d-4ad6-4eb5-bfa9-4e8b2b523c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:02.603956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 908/1832] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:02 2022] DELETE /identity/v3/projects/2fcfc959695c44ee8cd5db41caf351c0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:02.609042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489373-63ea-4fb4-9f75-c43cc2d43cf4 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:02.609337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489373-63ea-4fb4-9f75-c43cc2d43cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:02.609618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489373-63ea-4fb4-9f75-c43cc2d43cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:02.630025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-76489373-63ea-4fb4-9f75-c43cc2d43cf4 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:02.631288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-76489373-63ea-4fb4-9f75-c43cc2d43cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:02.710125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 925/1833] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:02.722354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b73c0-0d0f-4ef6-ac1e-d31c4a6a853c None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:02.723528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b73c0-0d0f-4ef6-ac1e-d31c4a6a853c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:02.724039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b73c0-0d0f-4ef6-ac1e-d31c4a6a853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:02.751117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c30b73c0-0d0f-4ef6-ac1e-d31c4a6a853c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:02.752553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c30b73c0-0d0f-4ef6-ac1e-d31c4a6a853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:02.762342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 909/1834] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:02.766526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76489373-63ea-4fb4-9f75-c43cc2d43cf4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:02.776548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76489373-63ea-4fb4-9f75-c43cc2d43cf4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:02.783655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c77d8-4c37-4fe6-b793-b1c6adca6199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:02.784364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c77d8-4c37-4fe6-b793-b1c6adca6199 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:02.784721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c77d8-4c37-4fe6-b793-b1c6adca6199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:02.785070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c77d8-4c37-4fe6-b793-b1c6adca6199 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:02.785942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c77d8-4c37-4fe6-b793-b1c6adca6199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:02.786347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c77d8-4c37-4fe6-b793-b1c6adca6199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:02.790312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c77d8-4c37-4fe6-b793-b1c6adca6199 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:02.814962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 926/1835] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:02.820681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b73c0-0d0f-4ef6-ac1e-d31c4a6a853c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:02.833633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b73c0-0d0f-4ef6-ac1e-d31c4a6a853c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:02.848137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7e2ec-cf48-4b78-9f6d-23f71eb56548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:02.849278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7e2ec-cf48-4b78-9f6d-23f71eb56548 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:02.852703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7e2ec-cf48-4b78-9f6d-23f71eb56548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:02.853125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7e2ec-cf48-4b78-9f6d-23f71eb56548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:02.853793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7e2ec-cf48-4b78-9f6d-23f71eb56548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:02.855746 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7e2ec-cf48-4b78-9f6d-23f71eb56548 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:02.962664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 910/1836] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:02 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:02.964275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c77d8-4c37-4fe6-b793-b1c6adca6199 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:02.975166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c77d8-4c37-4fe6-b793-b1c6adca6199 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:03.084943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bc1b3-aaa3-4e68-b9b1-8f7541376535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:03.087049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bc1b3-aaa3-4e68-b9b1-8f7541376535 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:03.087451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bc1b3-aaa3-4e68-b9b1-8f7541376535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:03.087730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bc1b3-aaa3-4e68-b9b1-8f7541376535 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:03.089003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bc1b3-aaa3-4e68-b9b1-8f7541376535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:03.092101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bc1b3-aaa3-4e68-b9b1-8f7541376535 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:03.206012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 927/1837] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:02 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:03.210675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7e2ec-cf48-4b78-9f6d-23f71eb56548 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:03.222790 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7e2ec-cf48-4b78-9f6d-23f71eb56548 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:03.228951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7589b-2c23-464b-8a27-4a99fd5e913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:03.229566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7589b-2c23-464b-8a27-4a99fd5e913b admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:03.229872 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7589b-2c23-464b-8a27-4a99fd5e913b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:03.230150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7589b-2c23-464b-8a27-4a99fd5e913b admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:03.230824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7589b-2c23-464b-8a27-4a99fd5e913b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:03.232456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7589b-2c23-464b-8a27-4a99fd5e913b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:03.248992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 911/1838] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:03.249661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bc1b3-aaa3-4e68-b9b1-8f7541376535 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:03.261653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bc1b3-aaa3-4e68-b9b1-8f7541376535 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:03.267023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33175022-c752-4626-980a-acc11cee157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:03.268753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33175022-c752-4626-980a-acc11cee157d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:03.268753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33175022-c752-4626-980a-acc11cee157d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:03.268753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33175022-c752-4626-980a-acc11cee157d admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:03.268753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33175022-c752-4626-980a-acc11cee157d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:03.290175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33175022-c752-4626-980a-acc11cee157d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:03.310876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 928/1839] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:03.314447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7589b-2c23-464b-8a27-4a99fd5e913b admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:03.325433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7589b-2c23-464b-8a27-4a99fd5e913b admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:03.331498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95debadb-b234-4317-baa9-5716059cc145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:03.332695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95debadb-b234-4317-baa9-5716059cc145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:03.333404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95debadb-b234-4317-baa9-5716059cc145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:03.334010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95debadb-b234-4317-baa9-5716059cc145 admin admin] PATH_INFO: `/v3/projects/98dafdd587a4464e96555b3c66ee4970/users/36895e28aa774dc4994511e88c55245a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:03.365835 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95debadb-b234-4317-baa9-5716059cc145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dafdd587a4464e96555b3c66ee4970, user_id=36895e28aa774dc4994511e88c55245a, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:03.370989 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95debadb-b234-4317-baa9-5716059cc145 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:03.480670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 912/1840] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:03 2022] PUT /identity/v3/projects/98dafdd587a4464e96555b3c66ee4970/users/36895e28aa774dc4994511e88c55245a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:03.490994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2abd4-223b-4ac4-bf9e-69233fa85d66 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:03.493952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2abd4-223b-4ac4-bf9e-69233fa85d66 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:03.494255 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2abd4-223b-4ac4-bf9e-69233fa85d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:03.541612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a7b2abd4-223b-4ac4-bf9e-69233fa85d66 None None] MFA Rules not processed for user `36895e28aa774dc4994511e88c55245a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:03.543235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a7b2abd4-223b-4ac4-bf9e-69233fa85d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:03.640699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 929/1841] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:03.645162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95debadb-b234-4317-baa9-5716059cc145 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:03.767373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95debadb-b234-4317-baa9-5716059cc145 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:03.774904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671a664-b28f-41f6-8a76-bc8b06380014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:03.775856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671a664-b28f-41f6-8a76-bc8b06380014 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:03.776143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671a664-b28f-41f6-8a76-bc8b06380014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:03.776423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671a664-b28f-41f6-8a76-bc8b06380014 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:03.777261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671a664-b28f-41f6-8a76-bc8b06380014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:03.781116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671a664-b28f-41f6-8a76-bc8b06380014 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:03.933012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48942d7d-1949-483c-a6ab-d2980c44f53a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:03.933319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48942d7d-1949-483c-a6ab-d2980c44f53a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:03.933563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48942d7d-1949-483c-a6ab-d2980c44f53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:03.969324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 913/1842] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:03 2022] POST /identity/v3/projects => generated 385 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:03.970181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671a664-b28f-41f6-8a76-bc8b06380014 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.000738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-48942d7d-1949-483c-a6ab-d2980c44f53a None None] MFA Rules not processed for user `a5f09196b93b4f4fb1e8a291660d60b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:04.002352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-48942d7d-1949-483c-a6ab-d2980c44f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:04.092110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671a664-b28f-41f6-8a76-bc8b06380014 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.106950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833943c-3e4c-480a-9f77-c74de714025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.107605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833943c-3e4c-480a-9f77-c74de714025d admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.107885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833943c-3e4c-480a-9f77-c74de714025d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.108158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833943c-3e4c-480a-9f77-c74de714025d admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.108836 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833943c-3e4c-480a-9f77-c74de714025d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.110891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833943c-3e4c-480a-9f77-c74de714025d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.148081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 930/1843] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:04.149528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48942d7d-1949-483c-a6ab-d2980c44f53a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.150969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-48942d7d-1949-483c-a6ab-d2980c44f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:04.167870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48942d7d-1949-483c-a6ab-d2980c44f53a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.182613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86166c24-3b1a-4182-b33e-490525451475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.183877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166c24-3b1a-4182-b33e-490525451475 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.190314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166c24-3b1a-4182-b33e-490525451475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.191058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166c24-3b1a-4182-b33e-490525451475 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.191972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86166c24-3b1a-4182-b33e-490525451475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.195746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86166c24-3b1a-4182-b33e-490525451475 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.259688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 914/1844] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:03 2022] POST /identity/v3/users => generated 299 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:04.260710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833943c-3e4c-480a-9f77-c74de714025d admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.284120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833943c-3e4c-480a-9f77-c74de714025d admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.298746 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28064126-8759-4905-81cf-59e823bb8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.299367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28064126-8759-4905-81cf-59e823bb8329 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.299654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28064126-8759-4905-81cf-59e823bb8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.299981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28064126-8759-4905-81cf-59e823bb8329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.300652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28064126-8759-4905-81cf-59e823bb8329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.304691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28064126-8759-4905-81cf-59e823bb8329 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.331860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 915/1845] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:04.338162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28064126-8759-4905-81cf-59e823bb8329 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.353626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28064126-8759-4905-81cf-59e823bb8329 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.368901 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1c6fb-08eb-47ca-828d-a96f99a4d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.369594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c6fb-08eb-47ca-828d-a96f99a4d685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.369878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c6fb-08eb-47ca-828d-a96f99a4d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.370162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c6fb-08eb-47ca-828d-a96f99a4d685 admin admin] PATH_INFO: `/v3/projects/aa2e0baa973a49ab9c8ba8587a6bab1d/users/6f2b1d25cac34ded998563edc3b1a02c/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.389162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1c6fb-08eb-47ca-828d-a96f99a4d685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2e0baa973a49ab9c8ba8587a6bab1d, user_id=6f2b1d25cac34ded998563edc3b1a02c, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.392861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 931/1846] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:04 2022] POST /identity/v3/projects => generated 405 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:04.395868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1c6fb-08eb-47ca-828d-a96f99a4d685 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.396911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86166c24-3b1a-4182-b33e-490525451475 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.475283 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86166c24-3b1a-4182-b33e-490525451475 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.480996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f64add-27ec-4c47-aa22-94aff1042574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.481760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f64add-27ec-4c47-aa22-94aff1042574 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.482411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f64add-27ec-4c47-aa22-94aff1042574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.482760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f64add-27ec-4c47-aa22-94aff1042574 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.483521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f64add-27ec-4c47-aa22-94aff1042574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.485546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f64add-27ec-4c47-aa22-94aff1042574 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.500742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 916/1847] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:04 2022] PUT /identity/v3/projects/aa2e0baa973a49ab9c8ba8587a6bab1d/users/6f2b1d25cac34ded998563edc3b1a02c/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:04.504860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1c6fb-08eb-47ca-828d-a96f99a4d685 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.590395 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 932/1848] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:04 2022] POST /identity/v3/users => generated 309 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:04.592675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f64add-27ec-4c47-aa22-94aff1042574 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.624884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f64add-27ec-4c47-aa22-94aff1042574 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.659130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1c6fb-08eb-47ca-828d-a96f99a4d685 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.665493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e533e-0ba1-4a52-bb68-6488aea312cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.665903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e533e-0ba1-4a52-bb68-6488aea312cc admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.666291 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e533e-0ba1-4a52-bb68-6488aea312cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.666637 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e533e-0ba1-4a52-bb68-6488aea312cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.668344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e533e-0ba1-4a52-bb68-6488aea312cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.670024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e533e-0ba1-4a52-bb68-6488aea312cc admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.685942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 917/1849] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:04.686905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e533e-0ba1-4a52-bb68-6488aea312cc admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.698699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e533e-0ba1-4a52-bb68-6488aea312cc admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.702803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d69c-52de-4ba7-b4ed-1f86e92eeaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.703598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d96a5-a00d-4f26-9875-a8f2d37aa37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.703726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d69c-52de-4ba7-b4ed-1f86e92eeaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.704041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d69c-52de-4ba7-b4ed-1f86e92eeaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.704211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d96a5-a00d-4f26-9875-a8f2d37aa37a admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.704489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d69c-52de-4ba7-b4ed-1f86e92eeaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.704599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d96a5-a00d-4f26-9875-a8f2d37aa37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.704761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d96a5-a00d-4f26-9875-a8f2d37aa37a admin admin] PATH_INFO: `/v3/projects/aa2e0baa973a49ab9c8ba8587a6bab1d/users/6f2b1d25cac34ded998563edc3b1a02c/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.705484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93d69c-52de-4ba7-b4ed-1f86e92eeaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.706666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d96a5-a00d-4f26-9875-a8f2d37aa37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2e0baa973a49ab9c8ba8587a6bab1d, user_id=6f2b1d25cac34ded998563edc3b1a02c, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.707585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93d69c-52de-4ba7-b4ed-1f86e92eeaa9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.709569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d96a5-a00d-4f26-9875-a8f2d37aa37a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.718716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 933/1850] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:04.720868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 918/1851] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:04 2022] PUT /identity/v3/projects/aa2e0baa973a49ab9c8ba8587a6bab1d/users/6f2b1d25cac34ded998563edc3b1a02c/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:04.722820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d69c-52de-4ba7-b4ed-1f86e92eeaa9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.733496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d69c-52de-4ba7-b4ed-1f86e92eeaa9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.733587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996ff57-a028-4d0c-9eeb-1405f4dc940b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.733664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996ff57-a028-4d0c-9eeb-1405f4dc940b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.733934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996ff57-a028-4d0c-9eeb-1405f4dc940b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.764655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-0996ff57-a028-4d0c-9eeb-1405f4dc940b None None] MFA Rules not processed for user `6f2b1d25cac34ded998563edc3b1a02c`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:04.765829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0996ff57-a028-4d0c-9eeb-1405f4dc940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:04.801816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5e281-e4c4-4d0e-bc2d-c3ab34afca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.802540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5e281-e4c4-4d0e-bc2d-c3ab34afca01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.802827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5e281-e4c4-4d0e-bc2d-c3ab34afca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.803104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5e281-e4c4-4d0e-bc2d-c3ab34afca01 admin admin] PATH_INFO: `/v3/projects/31dece3d6f0646f9954190d0649d353a/users/a8d99095da3e4f1a92aca6b50bc16e47/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.825290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5e281-e4c4-4d0e-bc2d-c3ab34afca01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31dece3d6f0646f9954190d0649d353a, user_id=a8d99095da3e4f1a92aca6b50bc16e47, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.828760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5e281-e4c4-4d0e-bc2d-c3ab34afca01 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.904729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 919/1852] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:04.917959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996ff57-a028-4d0c-9eeb-1405f4dc940b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.919821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0996ff57-a028-4d0c-9eeb-1405f4dc940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:04.973651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 934/1853] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:04 2022] PUT /identity/v3/projects/31dece3d6f0646f9954190d0649d353a/users/a8d99095da3e4f1a92aca6b50bc16e47/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:04.983894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5e281-e4c4-4d0e-bc2d-c3ab34afca01 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.998514 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996ff57-a028-4d0c-9eeb-1405f4dc940b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:05.080111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc896c-b83a-4133-8b36-cb66bb3ee6b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:05.081393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc896c-b83a-4133-8b36-cb66bb3ee6b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.081393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc896c-b83a-4133-8b36-cb66bb3ee6b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.081607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc896c-b83a-4133-8b36-cb66bb3ee6b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.085046 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5e281-e4c4-4d0e-bc2d-c3ab34afca01 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:05.090949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad402a-0875-43e0-b18d-c5c8b0bd05fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:05.091574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad402a-0875-43e0-b18d-c5c8b0bd05fa admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.092049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad402a-0875-43e0-b18d-c5c8b0bd05fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.092335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad402a-0875-43e0-b18d-c5c8b0bd05fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.093566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad402a-0875-43e0-b18d-c5c8b0bd05fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:05.095575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad402a-0875-43e0-b18d-c5c8b0bd05fa admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.111135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 935/1854] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:05.112500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad402a-0875-43e0-b18d-c5c8b0bd05fa admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:05.123977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad402a-0875-43e0-b18d-c5c8b0bd05fa admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:05.131237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5dc44-9826-4664-8844-da571b237749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:05.132519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5dc44-9826-4664-8844-da571b237749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.133231 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5dc44-9826-4664-8844-da571b237749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.133673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5dc44-9826-4664-8844-da571b237749 admin admin] PATH_INFO: `/v3/projects/31dece3d6f0646f9954190d0649d353a/users/a8d99095da3e4f1a92aca6b50bc16e47/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.135951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5dc44-9826-4664-8844-da571b237749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31dece3d6f0646f9954190d0649d353a, user_id=a8d99095da3e4f1a92aca6b50bc16e47, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:05.139164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5dc44-9826-4664-8844-da571b237749 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.161275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 936/1855] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:05 2022] PUT /identity/v3/projects/31dece3d6f0646f9954190d0649d353a/users/a8d99095da3e4f1a92aca6b50bc16e47/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:05.162530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc896c-b83a-4133-8b36-cb66bb3ee6b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:05.165050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc896c-b83a-4133-8b36-cb66bb3ee6b3 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.186435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 920/1856] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:05.221251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5dc44-9826-4664-8844-da571b237749 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:05.306940 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5dc44-9826-4664-8844-da571b237749 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:05.312443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:05.313091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.313370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.313645 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] PATH_INFO: `/v3/users/36895e28aa774dc4994511e88c55245a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.314811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36895e28aa774dc4994511e88c55245a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:05.316800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.438764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:05.527315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36895e28aa774dc4994511e88c55245a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:05.528195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36895e28aa774dc4994511e88c55245a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:05.539981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36895e28aa774dc4994511e88c55245a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:05.593977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36895e28aa774dc4994511e88c55245a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:05.739577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36895e28aa774dc4994511e88c55245a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:05.764331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 937/1857] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:05 2022] DELETE /identity/v3/users/36895e28aa774dc4994511e88c55245a => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:05.770354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6be86-271b-45fc-8832-8eb5788d4963 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.770743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6be86-271b-45fc-8832-8eb5788d4963 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.771114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6be86-271b-45fc-8832-8eb5788d4963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.805080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-d5b6be86-271b-45fc-8832-8eb5788d4963 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:05.806751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d5b6be86-271b-45fc-8832-8eb5788d4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:05.897254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 921/1858] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:05.942394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:05.943912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:06.081570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dcad5-564b-416d-898c-7262b3361284 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:06.092196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff08d-c25e-4537-a785-c801bdaad68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:06.092916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff08d-c25e-4537-a785-c801bdaad68b service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:06.093267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff08d-c25e-4537-a785-c801bdaad68b service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:06.093616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff08d-c25e-4537-a785-c801bdaad68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:06.105227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ff08d-c25e-4537-a785-c801bdaad68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:06.106434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ff08d-c25e-4537-a785-c801bdaad68b service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:06.124458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 938/1859] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:06.340048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:06.959571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6be86-271b-45fc-8832-8eb5788d4963 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:06.962320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d5b6be86-271b-45fc-8832-8eb5788d4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:06.980751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6be86-271b-45fc-8832-8eb5788d4963 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:06.993384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:06.994214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:06.994515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:06.994786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] PATH_INFO: `/v3/projects/98dafdd587a4464e96555b3c66ee4970` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:06.996130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=98dafdd587a4464e96555b3c66ee4970)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:06.998046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:07.015549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32da9-53d7-4250-86bd-744c1273db7c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:07.016005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32da9-53d7-4250-86bd-744c1273db7c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:07.016211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32da9-53d7-4250-86bd-744c1273db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:07.086827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0bf32da9-53d7-4250-86bd-744c1273db7c None None] MFA Rules not processed for user `a8d99095da3e4f1a92aca6b50bc16e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:07.088440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0bf32da9-53d7-4250-86bd-744c1273db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:07.209610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 939/1860] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:07.243766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98dafdd587a4464e96555b3c66ee4970', 'request_id': 'req-7234b729-19b5-46cd-91a4-e8fd72411e0d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:07.322788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98dafdd587a4464e96555b3c66ee4970', 'request_id': 'req-7234b729-19b5-46cd-91a4-e8fd72411e0d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:07.331874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98dafdd587a4464e96555b3c66ee4970', 'request_id': 'req-7234b729-19b5-46cd-91a4-e8fd72411e0d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:07.359779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] The token cache is being invalidate because project 98dafdd587a4464e96555b3c66ee4970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:07.361409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:07.363065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7234b729-19b5-46cd-91a4-e8fd72411e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:07.371050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 922/1861] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:06 2022] DELETE /identity/v3/projects/98dafdd587a4464e96555b3c66ee4970 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:07.372156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf32da9-53d7-4250-86bd-744c1273db7c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:07.386811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf32da9-53d7-4250-86bd-744c1273db7c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:07.459790 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:07.460558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:07.460854 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:07.461133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] PATH_INFO: `/v3/users/6f2b1d25cac34ded998563edc3b1a02c` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:07.462366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2b1d25cac34ded998563edc3b1a02c)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:07.464512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:07.690258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2b1d25cac34ded998563edc3b1a02c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:07.690528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2b1d25cac34ded998563edc3b1a02c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:07.699597 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2b1d25cac34ded998563edc3b1a02c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:07.718149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2b1d25cac34ded998563edc3b1a02c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:07.859315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b786b9de-e656-4c58-9464-29b0a29f005e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2b1d25cac34ded998563edc3b1a02c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:07.866415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 940/1862] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:07 2022] DELETE /identity/v3/users/6f2b1d25cac34ded998563edc3b1a02c => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:07.956964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:08.440566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c59d2-d16a-4ca2-87a6-cd27ec6cde5f None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:08.441117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c59d2-d16a-4ca2-87a6-cd27ec6cde5f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:08.441117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c59d2-d16a-4ca2-87a6-cd27ec6cde5f None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:08.442688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 923/1863] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:48:08.457047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de5251-3da9-4987-8751-6f35f3896477 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:08.457891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de5251-3da9-4987-8751-6f35f3896477 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:08.457891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de5251-3da9-4987-8751-6f35f3896477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:08.482433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c59d2-d16a-4ca2-87a6-cd27ec6cde5f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:08.482433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d68c59d2-d16a-4ca2-87a6-cd27ec6cde5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:08.487201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a0de5251-3da9-4987-8751-6f35f3896477 None None] MFA Rules not processed for user `6fa8495c97df48f18b10039584d52f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:08.488626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a0de5251-3da9-4987-8751-6f35f3896477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:08.560350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 941/1864] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:48:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:08.573648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de5251-3da9-4987-8751-6f35f3896477 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:08.575211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a0de5251-3da9-4987-8751-6f35f3896477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:08.576614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c59d2-d16a-4ca2-87a6-cd27ec6cde5f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:08.581180 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:08.581816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:08.582123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:08.582685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] PATH_INFO: `/v3/projects/aa2e0baa973a49ab9c8ba8587a6bab1d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:08.583864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2e0baa973a49ab9c8ba8587a6bab1d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:08.586939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:08.588794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de5251-3da9-4987-8751-6f35f3896477 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:08.604841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d22b1-cf97-4784-af17-3152e669907f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8495c97df48f18b10039584d52f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:08.605672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d22b1-cf97-4784-af17-3152e669907f service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:08.606065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d22b1-cf97-4784-af17-3152e669907f service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:08.607369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d22b1-cf97-4784-af17-3152e669907f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:08.616138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d22b1-cf97-4784-af17-3152e669907f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:08.618008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d22b1-cf97-4784-af17-3152e669907f service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:08.633128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 942/1865] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:08.740336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2e0baa973a49ab9c8ba8587a6bab1d', 'request_id': 'req-67f20a47-0abe-43d4-8a68-b9c098335508'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.870887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2e0baa973a49ab9c8ba8587a6bab1d', 'request_id': 'req-67f20a47-0abe-43d4-8a68-b9c098335508'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.884968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2e0baa973a49ab9c8ba8587a6bab1d', 'request_id': 'req-67f20a47-0abe-43d4-8a68-b9c098335508'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.904414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] The token cache is being invalidate because project aa2e0baa973a49ab9c8ba8587a6bab1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:08.905336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.906120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-67f20a47-0abe-43d4-8a68-b9c098335508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.908049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 924/1866] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:08 2022] DELETE /identity/v3/projects/aa2e0baa973a49ab9c8ba8587a6bab1d => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:08.912880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4a93-c95c-4327-8ab6-ca30300c9582 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:08.913248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4a93-c95c-4327-8ab6-ca30300c9582 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:08.914295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4a93-c95c-4327-8ab6-ca30300c9582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:08.943678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0f7f4a93-c95c-4327-8ab6-ca30300c9582 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:08.945237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0f7f4a93-c95c-4327-8ab6-ca30300c9582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:09.017706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 943/1867] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:09.026644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c0b34-938d-47b5-b20d-92be87c30050 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.027000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c0b34-938d-47b5-b20d-92be87c30050 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.027352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c0b34-938d-47b5-b20d-92be87c30050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.053326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-624c0b34-938d-47b5-b20d-92be87c30050 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:09.055249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-624c0b34-938d-47b5-b20d-92be87c30050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:09.065148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 925/1868] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:09.069223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f4a93-c95c-4327-8ab6-ca30300c9582 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.080281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f4a93-c95c-4327-8ab6-ca30300c9582 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.087451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c9f5c-3e8a-402f-9f2a-0efef87da896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.088209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9f5c-3e8a-402f-9f2a-0efef87da896 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.089889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9f5c-3e8a-402f-9f2a-0efef87da896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.089889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9f5c-3e8a-402f-9f2a-0efef87da896 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.090682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c9f5c-3e8a-402f-9f2a-0efef87da896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:09.091121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c9f5c-3e8a-402f-9f2a-0efef87da896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.092997 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c9f5c-3e8a-402f-9f2a-0efef87da896 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.122684 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 944/1869] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:09.126823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c0b34-938d-47b5-b20d-92be87c30050 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.136626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c0b34-938d-47b5-b20d-92be87c30050 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.141949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba131c-1002-41a5-a370-8a644f0a57f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.142593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba131c-1002-41a5-a370-8a644f0a57f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.143379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba131c-1002-41a5-a370-8a644f0a57f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.143379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba131c-1002-41a5-a370-8a644f0a57f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.143921 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba131c-1002-41a5-a370-8a644f0a57f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.145828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba131c-1002-41a5-a370-8a644f0a57f6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.269845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 926/1870] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:09 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:09.273369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c9f5c-3e8a-402f-9f2a-0efef87da896 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.284024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c9f5c-3e8a-402f-9f2a-0efef87da896 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.346470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c44fa5-cb4f-4cd9-955b-8bd1eccc6ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.347082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44fa5-cb4f-4cd9-955b-8bd1eccc6ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.347379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44fa5-cb4f-4cd9-955b-8bd1eccc6ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.347648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44fa5-cb4f-4cd9-955b-8bd1eccc6ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.348269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c44fa5-cb4f-4cd9-955b-8bd1eccc6ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.350173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c44fa5-cb4f-4cd9-955b-8bd1eccc6ff3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.407327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba131c-1002-41a5-a370-8a644f0a57f6 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.409321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-76ba131c-1002-41a5-a370-8a644f0a57f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:09.424374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba131c-1002-41a5-a370-8a644f0a57f6 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.429917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.430588 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.430894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.431178 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] PATH_INFO: `/v3/users/a5f09196b93b4f4fb1e8a291660d60b1` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.432321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f09196b93b4f4fb1e8a291660d60b1)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.434366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.450962 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:09.490588 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 945/1871] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:09 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:09.493123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c44fa5-cb4f-4cd9-955b-8bd1eccc6ff3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.503227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c44fa5-cb4f-4cd9-955b-8bd1eccc6ff3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.508246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527ee23-366b-4231-ad14-02bb7952073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.508923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527ee23-366b-4231-ad14-02bb7952073b admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.509205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527ee23-366b-4231-ad14-02bb7952073b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.509478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527ee23-366b-4231-ad14-02bb7952073b admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.510119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527ee23-366b-4231-ad14-02bb7952073b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.511773 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527ee23-366b-4231-ad14-02bb7952073b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.525803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 946/1872] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:09.528460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527ee23-366b-4231-ad14-02bb7952073b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.537663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527ee23-366b-4231-ad14-02bb7952073b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.543031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72ab26-d886-4c0d-b524-a91d470569b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.544906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72ab26-d886-4c0d-b524-a91d470569b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.545192 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72ab26-d886-4c0d-b524-a91d470569b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.545464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72ab26-d886-4c0d-b524-a91d470569b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.546091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72ab26-d886-4c0d-b524-a91d470569b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.547702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72ab26-d886-4c0d-b524-a91d470569b8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.558476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 947/1873] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:09.562402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72ab26-d886-4c0d-b524-a91d470569b8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.571987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72ab26-d886-4c0d-b524-a91d470569b8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.576463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eff11-7847-4715-878a-442990e9a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.577092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eff11-7847-4715-878a-442990e9a13e admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.577433 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eff11-7847-4715-878a-442990e9a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.577764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eff11-7847-4715-878a-442990e9a13e admin admin] PATH_INFO: `/v3/projects/97e25c5a2683470cbdae1b1d92cfe678/users/11557206ca74408bb417565b192531d2/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.594441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eff11-7847-4715-878a-442990e9a13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e25c5a2683470cbdae1b1d92cfe678, user_id=11557206ca74408bb417565b192531d2, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.597135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eff11-7847-4715-878a-442990e9a13e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.701099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f09196b93b4f4fb1e8a291660d60b1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:09.713553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f09196b93b4f4fb1e8a291660d60b1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:09.746470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 948/1874] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:09 2022] PUT /identity/v3/projects/97e25c5a2683470cbdae1b1d92cfe678/users/11557206ca74408bb417565b192531d2/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:09.756529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4986b-8d55-49dc-9f68-33288578c60d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.757088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4986b-8d55-49dc-9f68-33288578c60d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.757949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4986b-8d55-49dc-9f68-33288578c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.785529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f7c4986b-8d55-49dc-9f68-33288578c60d None None] MFA Rules not processed for user `11557206ca74408bb417565b192531d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:09.786692 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f7c4986b-8d55-49dc-9f68-33288578c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:09.847721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f09196b93b4f4fb1e8a291660d60b1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:09.850769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 949/1875] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:09.856003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4986b-8d55-49dc-9f68-33288578c60d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.856341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f09196b93b4f4fb1e8a291660d60b1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:09.857011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f09196b93b4f4fb1e8a291660d60b1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:09.863242 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 927/1876] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:09 2022] DELETE /identity/v3/users/a5f09196b93b4f4fb1e8a291660d60b1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:09.924711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4986b-8d55-49dc-9f68-33288578c60d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:10.002496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edec9a3-e4bf-4b29-82df-d0ed7e20a9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:10.003140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec9a3-e4bf-4b29-82df-d0ed7e20a9dc admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.003429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec9a3-e4bf-4b29-82df-d0ed7e20a9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.003707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec9a3-e4bf-4b29-82df-d0ed7e20a9dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.004339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edec9a3-e4bf-4b29-82df-d0ed7e20a9dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:10.006394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edec9a3-e4bf-4b29-82df-d0ed7e20a9dc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:10.139130 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 950/1877] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:09 2022] POST /identity/v3/projects => generated 383 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:10.143309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:10.144717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:10.158187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db54229-0923-4a86-a314-290ad6d95c54 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:10.219297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375cdd-0690-44c7-a825-4f702af5c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:10.219875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375cdd-0690-44c7-a825-4f702af5c2ed admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.220520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375cdd-0690-44c7-a825-4f702af5c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.220861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375cdd-0690-44c7-a825-4f702af5c2ed admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.221467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a375cdd-0690-44c7-a825-4f702af5c2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:10.227969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a375cdd-0690-44c7-a825-4f702af5c2ed admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:10.250441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edec9a3-e4bf-4b29-82df-d0ed7e20a9dc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:10.252552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9edec9a3-e4bf-4b29-82df-d0ed7e20a9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:10.266808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edec9a3-e4bf-4b29-82df-d0ed7e20a9dc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:10.286745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:10.287433 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.287722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.288054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] PATH_INFO: `/v3/projects/6eecdc5fe2164b9cad375a8894b583c0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.290988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eecdc5fe2164b9cad375a8894b583c0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:10.293708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:10.397044 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 928/1878] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:10 2022] POST /identity/v3/users => generated 298 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:10.402007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375cdd-0690-44c7-a825-4f702af5c2ed admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:10.412134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375cdd-0690-44c7-a825-4f702af5c2ed admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:10.418455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d8878-21ed-43f8-9fcd-6e110b6bb559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:10.419211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d8878-21ed-43f8-9fcd-6e110b6bb559 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.419443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d8878-21ed-43f8-9fcd-6e110b6bb559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.419701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d8878-21ed-43f8-9fcd-6e110b6bb559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.420592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d8878-21ed-43f8-9fcd-6e110b6bb559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:10.422348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d8878-21ed-43f8-9fcd-6e110b6bb559 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:10.444758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 929/1879] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:10.450417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d8878-21ed-43f8-9fcd-6e110b6bb559 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:10.451948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eecdc5fe2164b9cad375a8894b583c0', 'request_id': 'req-57711a39-0058-4748-b73f-3799fcf89897'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:10.459471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eecdc5fe2164b9cad375a8894b583c0', 'request_id': 'req-57711a39-0058-4748-b73f-3799fcf89897'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:10.461863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d8878-21ed-43f8-9fcd-6e110b6bb559 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:10.520773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf230e7-965a-4f7e-a273-66213f63b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:10.521439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf230e7-965a-4f7e-a273-66213f63b94c admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.521727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf230e7-965a-4f7e-a273-66213f63b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.522003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf230e7-965a-4f7e-a273-66213f63b94c admin admin] PATH_INFO: `/v3/projects/8ada7efca2554028ba340369669ad6bf/users/fe846b43f3464a849f6adab1bfc4d594/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.538214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf230e7-965a-4f7e-a273-66213f63b94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ada7efca2554028ba340369669ad6bf, user_id=fe846b43f3464a849f6adab1bfc4d594, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:10.541564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf230e7-965a-4f7e-a273-66213f63b94c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:10.578978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eecdc5fe2164b9cad375a8894b583c0', 'request_id': 'req-57711a39-0058-4748-b73f-3799fcf89897'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:10.591314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] The token cache is being invalidate because project 6eecdc5fe2164b9cad375a8894b583c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:10.591645 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:10.592314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:10.593836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 951/1880] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:10 2022] DELETE /identity/v3/projects/6eecdc5fe2164b9cad375a8894b583c0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:10.597791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:10.599612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:10.613122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57711a39-0058-4748-b73f-3799fcf89897 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:10.617850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:10.618511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.618830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.619113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] PATH_INFO: `/v3/users/a8d99095da3e4f1a92aca6b50bc16e47` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.620245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d99095da3e4f1a92aca6b50bc16e47)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:10.622204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:10.659355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 930/1881] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:10 2022] PUT /identity/v3/projects/8ada7efca2554028ba340369669ad6bf/users/fe846b43f3464a849f6adab1bfc4d594/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:10.664006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf230e7-965a-4f7e-a273-66213f63b94c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:10.665877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-aaf230e7-965a-4f7e-a273-66213f63b94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:10.735761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf230e7-965a-4f7e-a273-66213f63b94c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:10.740378 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e6af5-bdf7-4eec-a913-e2537ca30975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:10.740984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e6af5-bdf7-4eec-a913-e2537ca30975 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.741268 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e6af5-bdf7-4eec-a913-e2537ca30975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.741585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e6af5-bdf7-4eec-a913-e2537ca30975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.742264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e6af5-bdf7-4eec-a913-e2537ca30975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:10.743858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e6af5-bdf7-4eec-a913-e2537ca30975 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:10.753752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 931/1882] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:10.759119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e6af5-bdf7-4eec-a913-e2537ca30975 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:10.768763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e6af5-bdf7-4eec-a913-e2537ca30975 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:10.774092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bdf6f-10df-43e9-9967-ff5bbdcd44e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:10.774799 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bdf6f-10df-43e9-9967-ff5bbdcd44e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.775089 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bdf6f-10df-43e9-9967-ff5bbdcd44e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.775368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bdf6f-10df-43e9-9967-ff5bbdcd44e2 admin admin] PATH_INFO: `/v3/projects/8ada7efca2554028ba340369669ad6bf/users/fe846b43f3464a849f6adab1bfc4d594/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.777409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bdf6f-10df-43e9-9967-ff5bbdcd44e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ada7efca2554028ba340369669ad6bf, user_id=fe846b43f3464a849f6adab1bfc4d594, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:10.780205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bdf6f-10df-43e9-9967-ff5bbdcd44e2 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:10.791777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 932/1883] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:10 2022] PUT /identity/v3/projects/8ada7efca2554028ba340369669ad6bf/users/fe846b43f3464a849f6adab1bfc4d594/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:10.801900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a1eb-feba-4e63-a8c4-89d56b48b619 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.802219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a1eb-feba-4e63-a8c4-89d56b48b619 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.807515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a1eb-feba-4e63-a8c4-89d56b48b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.830601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-3aa8a1eb-feba-4e63-a8c4-89d56b48b619 None None] MFA Rules not processed for user `fe846b43f3464a849f6adab1bfc4d594`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:10.831821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3aa8a1eb-feba-4e63-a8c4-89d56b48b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:10.902570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 933/1884] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:10.914149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a1eb-feba-4e63-a8c4-89d56b48b619 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:10.916050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3aa8a1eb-feba-4e63-a8c4-89d56b48b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:10.933786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d99095da3e4f1a92aca6b50bc16e47'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:10.934509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d99095da3e4f1a92aca6b50bc16e47'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:10.941652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d99095da3e4f1a92aca6b50bc16e47'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:10.955305 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d99095da3e4f1a92aca6b50bc16e47'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:10.976288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a1eb-feba-4e63-a8c4-89d56b48b619 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:10.980504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28981a99-8226-40e8-9552-86f1a70a9594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:10.981127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28981a99-8226-40e8-9552-86f1a70a9594 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.981409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28981a99-8226-40e8-9552-86f1a70a9594 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.982053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28981a99-8226-40e8-9552-86f1a70a9594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.983590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-28981a99-8226-40e8-9552-86f1a70a9594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:10.993009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:10.996832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28981a99-8226-40e8-9552-86f1a70a9594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:10.998314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28981a99-8226-40e8-9552-86f1a70a9594 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:11.009463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 934/1885] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:11.053480 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d99095da3e4f1a92aca6b50bc16e47'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:11.063369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 952/1886] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:10 2022] DELETE /identity/v3/users/a8d99095da3e4f1a92aca6b50bc16e47 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:11.120890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28981a99-8226-40e8-9552-86f1a70a9594 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:11.122354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-28981a99-8226-40e8-9552-86f1a70a9594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:11.133071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28981a99-8226-40e8-9552-86f1a70a9594 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:11.192309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132a814-1bbc-4a10-b572-31e55d24a558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:11.192935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132a814-1bbc-4a10-b572-31e55d24a558 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:11.193219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132a814-1bbc-4a10-b572-31e55d24a558 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:11.193494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132a814-1bbc-4a10-b572-31e55d24a558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:11.195976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8132a814-1bbc-4a10-b572-31e55d24a558 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:11.265708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132a814-1bbc-4a10-b572-31e55d24a558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:11.267205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132a814-1bbc-4a10-b572-31e55d24a558 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:11.277622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 935/1887] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:11.364863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:11.366680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:11.452419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fb329-25e3-4040-a30f-2dff2e8d8c75 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:11.457073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:11.458030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:11.458321 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:11.458648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] PATH_INFO: `/v3/projects/31dece3d6f0646f9954190d0649d353a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:11.459738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31dece3d6f0646f9954190d0649d353a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:11.462486 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:11.593388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31dece3d6f0646f9954190d0649d353a', 'request_id': 'req-9672a82d-f70e-4139-bf2c-d06d61f921e3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:11.599741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31dece3d6f0646f9954190d0649d353a', 'request_id': 'req-9672a82d-f70e-4139-bf2c-d06d61f921e3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:11.733601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31dece3d6f0646f9954190d0649d353a', 'request_id': 'req-9672a82d-f70e-4139-bf2c-d06d61f921e3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:11.751487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] The token cache is being invalidate because project 31dece3d6f0646f9954190d0649d353a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:11.751911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:11.752650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9672a82d-f70e-4139-bf2c-d06d61f921e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:11.757795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 953/1888] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:11 2022] DELETE /identity/v3/projects/31dece3d6f0646f9954190d0649d353a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:11.759468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b00227-5713-4a56-8af8-61d1a7037991 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:11.759912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b00227-5713-4a56-8af8-61d1a7037991 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:11.760100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b00227-5713-4a56-8af8-61d1a7037991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:11.780927 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-60b00227-5713-4a56-8af8-61d1a7037991 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:11.782255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-60b00227-5713-4a56-8af8-61d1a7037991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:11.844794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 936/1889] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:11.854262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984ba3-6a98-4408-8ba4-6bb363cdbf17 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:11.859270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984ba3-6a98-4408-8ba4-6bb363cdbf17 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:11.859270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984ba3-6a98-4408-8ba4-6bb363cdbf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:11.875855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c8984ba3-6a98-4408-8ba4-6bb363cdbf17 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:11.877156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c8984ba3-6a98-4408-8ba4-6bb363cdbf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:11.885998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 954/1890] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:11.889924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b00227-5713-4a56-8af8-61d1a7037991 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:11.900761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b00227-5713-4a56-8af8-61d1a7037991 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:11.905585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ba671-9b67-4ad5-9139-6c88bfbff8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:11.906213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ba671-9b67-4ad5-9139-6c88bfbff8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:11.906497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ba671-9b67-4ad5-9139-6c88bfbff8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:11.906769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ba671-9b67-4ad5-9139-6c88bfbff8a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:11.907418 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ba671-9b67-4ad5-9139-6c88bfbff8a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:11.907724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ba671-9b67-4ad5-9139-6c88bfbff8a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:11.909326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ba671-9b67-4ad5-9139-6c88bfbff8a2 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:11.925222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 937/1891] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:11.926663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984ba3-6a98-4408-8ba4-6bb363cdbf17 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:11.937049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984ba3-6a98-4408-8ba4-6bb363cdbf17 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:11.941923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347b016-721a-4755-9c04-86a9f801ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:11.942629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347b016-721a-4755-9c04-86a9f801ae43 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:11.943038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347b016-721a-4755-9c04-86a9f801ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:11.943328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347b016-721a-4755-9c04-86a9f801ae43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:11.945430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347b016-721a-4755-9c04-86a9f801ae43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:11.946271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347b016-721a-4755-9c04-86a9f801ae43 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:12.126151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 955/1892] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:11 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:12.130366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ba671-9b67-4ad5-9139-6c88bfbff8a2 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:12.153465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ba671-9b67-4ad5-9139-6c88bfbff8a2 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:12.230365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4a08-b789-444d-b14f-bc42607c5ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:12.230997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4a08-b789-444d-b14f-bc42607c5ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:12.231301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4a08-b789-444d-b14f-bc42607c5ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:12.231581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4a08-b789-444d-b14f-bc42607c5ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:12.232376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff4a08-b789-444d-b14f-bc42607c5ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:12.234391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff4a08-b789-444d-b14f-bc42607c5ac7 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:12.265295 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:12.329675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 938/1893] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:12 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:12.334257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347b016-721a-4755-9c04-86a9f801ae43 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:12.346139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347b016-721a-4755-9c04-86a9f801ae43 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:12.351260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21635ba-ce58-4e35-8ed1-f15f377bff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:12.351944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21635ba-ce58-4e35-8ed1-f15f377bff77 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:12.352281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21635ba-ce58-4e35-8ed1-f15f377bff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:12.352509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21635ba-ce58-4e35-8ed1-f15f377bff77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:12.353159 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21635ba-ce58-4e35-8ed1-f15f377bff77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:12.354812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21635ba-ce58-4e35-8ed1-f15f377bff77 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:12.365453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 956/1894] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:12.370376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4a08-b789-444d-b14f-bc42607c5ac7 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:12.380445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4a08-b789-444d-b14f-bc42607c5ac7 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:12.385882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91021c-8aa8-405b-a5d6-7714478ec17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:12.386555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91021c-8aa8-405b-a5d6-7714478ec17d admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:12.386827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91021c-8aa8-405b-a5d6-7714478ec17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:12.387106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91021c-8aa8-405b-a5d6-7714478ec17d admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:12.387748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91021c-8aa8-405b-a5d6-7714478ec17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:12.389610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91021c-8aa8-405b-a5d6-7714478ec17d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:12.401729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 939/1895] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:12.406026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21635ba-ce58-4e35-8ed1-f15f377bff77 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:12.416466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21635ba-ce58-4e35-8ed1-f15f377bff77 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:12.421154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502d856-f7f8-4b0d-a83d-90f0c6648d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:12.421814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502d856-f7f8-4b0d-a83d-90f0c6648d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:12.422104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502d856-f7f8-4b0d-a83d-90f0c6648d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:12.422434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502d856-f7f8-4b0d-a83d-90f0c6648d35 admin admin] PATH_INFO: `/v3/projects/2429b3f6a4094940902373b8496abfbd/users/ad428001b0574dd39f83312fc87dce0f/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:12.437879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502d856-f7f8-4b0d-a83d-90f0c6648d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2429b3f6a4094940902373b8496abfbd, user_id=ad428001b0574dd39f83312fc87dce0f, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:12.440618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502d856-f7f8-4b0d-a83d-90f0c6648d35 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:12.603985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 957/1896] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:12 2022] PUT /identity/v3/projects/2429b3f6a4094940902373b8496abfbd/users/ad428001b0574dd39f83312fc87dce0f/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:12.614104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5b4bf-5306-4d0d-8d64-6da515e50f5c None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:12.614429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5b4bf-5306-4d0d-8d64-6da515e50f5c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:12.614768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5b4bf-5306-4d0d-8d64-6da515e50f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:12.644978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e1a5b4bf-5306-4d0d-8d64-6da515e50f5c None None] MFA Rules not processed for user `ad428001b0574dd39f83312fc87dce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:12.646351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e1a5b4bf-5306-4d0d-8d64-6da515e50f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:12.719127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 940/1897] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:12.723929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502d856-f7f8-4b0d-a83d-90f0c6648d35 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:12.837746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502d856-f7f8-4b0d-a83d-90f0c6648d35 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:12.843736 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e879b-5a8c-414d-b3ca-1fe0e16c8771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:12.844760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e879b-5a8c-414d-b3ca-1fe0e16c8771 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:12.845278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e879b-5a8c-414d-b3ca-1fe0e16c8771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:12.845779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e879b-5a8c-414d-b3ca-1fe0e16c8771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:12.847068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e879b-5a8c-414d-b3ca-1fe0e16c8771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:12.849455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e879b-5a8c-414d-b3ca-1fe0e16c8771 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:12.987270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5b4bf-5306-4d0d-8d64-6da515e50f5c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:12.988776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 958/1898] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:12 2022] POST /identity/v3/projects => generated 379 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:13.000996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5b4bf-5306-4d0d-8d64-6da515e50f5c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:13.091792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71248a17-444f-4955-8e4f-37a0cead2da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:13.092809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71248a17-444f-4955-8e4f-37a0cead2da2 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:13.093249 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71248a17-444f-4955-8e4f-37a0cead2da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:13.093691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71248a17-444f-4955-8e4f-37a0cead2da2 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:13.094424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71248a17-444f-4955-8e4f-37a0cead2da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:13.096853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71248a17-444f-4955-8e4f-37a0cead2da2 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:13.229539 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 941/1899] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:12 2022] POST /identity/v3/users => generated 296 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:13.230011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e879b-5a8c-414d-b3ca-1fe0e16c8771 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:13.240331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e879b-5a8c-414d-b3ca-1fe0e16c8771 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:13.246673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd4e93-4aaa-45d8-bc0b-68113ca69295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:13.247308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd4e93-4aaa-45d8-bc0b-68113ca69295 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:13.247607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd4e93-4aaa-45d8-bc0b-68113ca69295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:13.247888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd4e93-4aaa-45d8-bc0b-68113ca69295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:13.248547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd4e93-4aaa-45d8-bc0b-68113ca69295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:13.250181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd4e93-4aaa-45d8-bc0b-68113ca69295 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:13.262086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 959/1900] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:13.265953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71248a17-444f-4955-8e4f-37a0cead2da2 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:13.276449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71248a17-444f-4955-8e4f-37a0cead2da2 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:13.281027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765697fb-da10-4470-a409-388d6e92d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:13.286822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765697fb-da10-4470-a409-388d6e92d4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:13.286822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765697fb-da10-4470-a409-388d6e92d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:13.286822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765697fb-da10-4470-a409-388d6e92d4bd admin admin] PATH_INFO: `/v3/projects/70fe8ffb6269473dbb6596b059120641/users/2ffd2e91b96f4f08b302e2e81bbdc06b/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:13.300312 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765697fb-da10-4470-a409-388d6e92d4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fe8ffb6269473dbb6596b059120641, user_id=2ffd2e91b96f4f08b302e2e81bbdc06b, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:13.303189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765697fb-da10-4470-a409-388d6e92d4bd admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:13.441357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 942/1901] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:13 2022] PUT /identity/v3/projects/70fe8ffb6269473dbb6596b059120641/users/2ffd2e91b96f4f08b302e2e81bbdc06b/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:13.443167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd4e93-4aaa-45d8-bc0b-68113ca69295 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:13.458536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd4e93-4aaa-45d8-bc0b-68113ca69295 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:13.548118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ddd53-0345-464a-bf02-47dd84a7b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:13.549214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ddd53-0345-464a-bf02-47dd84a7b3dd admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:13.550219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ddd53-0345-464a-bf02-47dd84a7b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:13.553326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ddd53-0345-464a-bf02-47dd84a7b3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:13.553326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ddd53-0345-464a-bf02-47dd84a7b3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:13.556948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ddd53-0345-464a-bf02-47dd84a7b3dd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:13.574655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 960/1902] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:13.576287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765697fb-da10-4470-a409-388d6e92d4bd admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:13.586388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765697fb-da10-4470-a409-388d6e92d4bd admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:13.591470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660539a8-f82c-43c4-8668-cb125d03d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:13.592150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660539a8-f82c-43c4-8668-cb125d03d06a admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:13.592440 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660539a8-f82c-43c4-8668-cb125d03d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:13.592724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660539a8-f82c-43c4-8668-cb125d03d06a admin admin] PATH_INFO: `/v3/projects/70fe8ffb6269473dbb6596b059120641/users/2ffd2e91b96f4f08b302e2e81bbdc06b/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:13.594972 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660539a8-f82c-43c4-8668-cb125d03d06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fe8ffb6269473dbb6596b059120641, user_id=2ffd2e91b96f4f08b302e2e81bbdc06b, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:13.597673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660539a8-f82c-43c4-8668-cb125d03d06a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:13.610905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 943/1903] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:13 2022] PUT /identity/v3/projects/70fe8ffb6269473dbb6596b059120641/users/2ffd2e91b96f4f08b302e2e81bbdc06b/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:13.624898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c157b1-625c-4bbd-b796-cb6b5c2aea45 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:13.625746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c157b1-625c-4bbd-b796-cb6b5c2aea45 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:13.626174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c157b1-625c-4bbd-b796-cb6b5c2aea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:13.659767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-95c157b1-625c-4bbd-b796-cb6b5c2aea45 None None] MFA Rules not processed for user `2ffd2e91b96f4f08b302e2e81bbdc06b`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:13.661850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-95c157b1-625c-4bbd-b796-cb6b5c2aea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:13.821197 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 961/1904] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:13.833608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660539a8-f82c-43c4-8668-cb125d03d06a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:13.836327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-660539a8-f82c-43c4-8668-cb125d03d06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:13.919694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660539a8-f82c-43c4-8668-cb125d03d06a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:13.925572 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e67c62-96b1-4d15-b8e4-4eb27e35862d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:13.926334 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e67c62-96b1-4d15-b8e4-4eb27e35862d service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:13.926884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e67c62-96b1-4d15-b8e4-4eb27e35862d service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:13.927534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e67c62-96b1-4d15-b8e4-4eb27e35862d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:14.009427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e67c62-96b1-4d15-b8e4-4eb27e35862d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:14.013205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e67c62-96b1-4d15-b8e4-4eb27e35862d service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:14.026245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 944/1905] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:14.271957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:15.619481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:DELETE=18,keystone:SELECT=81,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:15.942401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c157b1-625c-4bbd-b796-cb6b5c2aea45 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:15.943872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-95c157b1-625c-4bbd-b796-cb6b5c2aea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.018713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c157b1-625c-4bbd-b796-cb6b5c2aea45 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.023979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.024625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.024904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.025182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] PATH_INFO: `/v3/users/11557206ca74408bb417565b192531d2` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.026394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] RBAC: Authorizing `identity:delete_user(user_id=11557206ca74408bb417565b192531d2)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.028320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.098141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e67c62-96b1-4d15-b8e4-4eb27e35862d service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.107036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e67c62-96b1-4d15-b8e4-4eb27e35862d service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.110735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d72e3-87a6-452a-aea6-a4af5ff01d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.111338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d72e3-87a6-452a-aea6-a4af5ff01d8a service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.111618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d72e3-87a6-452a-aea6-a4af5ff01d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.111888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d72e3-87a6-452a-aea6-a4af5ff01d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.121113 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d72e3-87a6-452a-aea6-a4af5ff01d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.122581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d72e3-87a6-452a-aea6-a4af5ff01d8a service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.132798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 945/1906] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:16.291148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11557206ca74408bb417565b192531d2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.291903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11557206ca74408bb417565b192531d2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.299275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11557206ca74408bb417565b192531d2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.312262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11557206ca74408bb417565b192531d2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.415293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11557206ca74408bb417565b192531d2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.425739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 962/1907] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:15 2022] DELETE /identity/v3/users/11557206ca74408bb417565b192531d2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:16.430175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db0ff-b3eb-4e65-944f-c3a7b7b6d0c9 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.430753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db0ff-b3eb-4e65-944f-c3a7b7b6d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.431042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db0ff-b3eb-4e65-944f-c3a7b7b6d0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.460890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a23db0ff-b3eb-4e65-944f-c3a7b7b6d0c9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:16.462129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a23db0ff-b3eb-4e65-944f-c3a7b7b6d0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.516849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.518306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.528656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 946/1908] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:16.538038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db0ff-b3eb-4e65-944f-c3a7b7b6d0c9 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.539722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a23db0ff-b3eb-4e65-944f-c3a7b7b6d0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.589845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b459921-dcd1-4754-9ae7-0d99eee0197f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.593467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.594218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.594676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.595028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] PATH_INFO: `/v3/users/d8fbedb63d2547ebb991b6a59defaa9a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.596289 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fbedb63d2547ebb991b6a59defaa9a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.598273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.601428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db0ff-b3eb-4e65-944f-c3a7b7b6d0c9 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.606558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbc6d8-18b0-4fe1-9259-2accd62eecf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.607329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbc6d8-18b0-4fe1-9259-2accd62eecf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.607619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbc6d8-18b0-4fe1-9259-2accd62eecf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.607952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbc6d8-18b0-4fe1-9259-2accd62eecf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.621561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbc6d8-18b0-4fe1-9259-2accd62eecf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.623562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbc6d8-18b0-4fe1-9259-2accd62eecf4 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.635602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 947/1909] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:17.274376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fbedb63d2547ebb991b6a59defaa9a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.275182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fbedb63d2547ebb991b6a59defaa9a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.282037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fbedb63d2547ebb991b6a59defaa9a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.294758 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fbedb63d2547ebb991b6a59defaa9a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.379318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e5632937-62ac-4445-b246-5e3cd8772274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fbedb63d2547ebb991b6a59defaa9a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.389028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbc6d8-18b0-4fe1-9259-2accd62eecf4 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.389776 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a2bbc6d8-18b0-4fe1-9259-2accd62eecf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.394544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 963/1910] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:16 2022] DELETE /identity/v3/users/d8fbedb63d2547ebb991b6a59defaa9a => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:17.402557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d376e-15a2-4fc0-8861-0aa0d0aabc8c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.402962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d376e-15a2-4fc0-8861-0aa0d0aabc8c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.403269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d376e-15a2-4fc0-8861-0aa0d0aabc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.405560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbc6d8-18b0-4fe1-9259-2accd62eecf4 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.442566 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:17.444326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-378d376e-15a2-4fc0-8861-0aa0d0aabc8c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:17.446913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-378d376e-15a2-4fc0-8861-0aa0d0aabc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.497836 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.498521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.498809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.499138 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] PATH_INFO: `/v3/projects/97e25c5a2683470cbdae1b1d92cfe678` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.500463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e25c5a2683470cbdae1b1d92cfe678)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.502661 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.523936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 964/1911] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:17.533978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d376e-15a2-4fc0-8861-0aa0d0aabc8c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.535427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-378d376e-15a2-4fc0-8861-0aa0d0aabc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.600114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d376e-15a2-4fc0-8861-0aa0d0aabc8c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.605268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9533420-5eea-4ef9-bd98-f797fa0df2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.606077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9533420-5eea-4ef9-bd98-f797fa0df2cb service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.606478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9533420-5eea-4ef9-bd98-f797fa0df2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.606751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9533420-5eea-4ef9-bd98-f797fa0df2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.617833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9533420-5eea-4ef9-bd98-f797fa0df2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.619540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9533420-5eea-4ef9-bd98-f797fa0df2cb service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.633838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 965/1912] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:17.652217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e25c5a2683470cbdae1b1d92cfe678', 'request_id': 'req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.818879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e25c5a2683470cbdae1b1d92cfe678', 'request_id': 'req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.825821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e25c5a2683470cbdae1b1d92cfe678', 'request_id': 'req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.837755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] The token cache is being invalidate because project 97e25c5a2683470cbdae1b1d92cfe678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:17.838076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.838828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.840313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 948/1913] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:17 2022] DELETE /identity/v3/projects/97e25c5a2683470cbdae1b1d92cfe678 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:17.844291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9533420-5eea-4ef9-bd98-f797fa0df2cb service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.845673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f9533420-5eea-4ef9-bd98-f797fa0df2cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.858706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9533420-5eea-4ef9-bd98-f797fa0df2cb service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.914612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.915172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.915451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.915762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] PATH_INFO: `/v3/users/fe846b43f3464a849f6adab1bfc4d594` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.916874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe846b43f3464a849f6adab1bfc4d594)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.918862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:18.147419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe846b43f3464a849f6adab1bfc4d594'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:18.148206 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe846b43f3464a849f6adab1bfc4d594'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:18.155900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe846b43f3464a849f6adab1bfc4d594'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:18.173863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe846b43f3464a849f6adab1bfc4d594'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:18.181834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:18.184862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:18.201480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f3aeb-42fa-4901-b5fb-104f5a587d7c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:18.218042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:18.219062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.219716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.220123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] PATH_INFO: `/v3/projects/59b3d4ea982344d68cfd3501e365ef6f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.221547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b3d4ea982344d68cfd3501e365ef6f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:18.223850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:18.299856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5d9db220-9aed-4dfe-9612-84a378071da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe846b43f3464a849f6adab1bfc4d594'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:18.308019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 966/1914] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:17 2022] DELETE /identity/v3/users/fe846b43f3464a849f6adab1bfc4d594 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:18.357638 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b3d4ea982344d68cfd3501e365ef6f', 'request_id': 'req-de006956-941c-4c54-8d4f-c86b43af30dc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:18.441896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b3d4ea982344d68cfd3501e365ef6f', 'request_id': 'req-de006956-941c-4c54-8d4f-c86b43af30dc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:18.448321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b3d4ea982344d68cfd3501e365ef6f', 'request_id': 'req-de006956-941c-4c54-8d4f-c86b43af30dc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:18.460743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] The token cache is being invalidate because project 59b3d4ea982344d68cfd3501e365ef6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:18.461035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:18.461837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-de006956-941c-4c54-8d4f-c86b43af30dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:18.463370 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 949/1915] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:18 2022] DELETE /identity/v3/projects/59b3d4ea982344d68cfd3501e365ef6f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:18.468073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663ce2a-630b-452f-8955-2f06288faa4f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.468370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663ce2a-630b-452f-8955-2f06288faa4f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.468650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663ce2a-630b-452f-8955-2f06288faa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.497298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e663ce2a-630b-452f-8955-2f06288faa4f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:18.497298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e663ce2a-630b-452f-8955-2f06288faa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:18.577834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 967/1916] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:18.585932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b4d2d-b895-4523-b9d9-ff70ecb2c2da None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.585932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b4d2d-b895-4523-b9d9-ff70ecb2c2da None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.585932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b4d2d-b895-4523-b9d9-ff70ecb2c2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.610778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-0a8b4d2d-b895-4523-b9d9-ff70ecb2c2da None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:18.613986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0a8b4d2d-b895-4523-b9d9-ff70ecb2c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:18.620623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 950/1917] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:18.625051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663ce2a-630b-452f-8955-2f06288faa4f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:18.635447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663ce2a-630b-452f-8955-2f06288faa4f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:18.640342 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac800542-2fb6-4b53-9db2-e492161a9622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:18.641487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac800542-2fb6-4b53-9db2-e492161a9622 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.641487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac800542-2fb6-4b53-9db2-e492161a9622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.641729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac800542-2fb6-4b53-9db2-e492161a9622 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.642483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac800542-2fb6-4b53-9db2-e492161a9622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:18.644688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac800542-2fb6-4b53-9db2-e492161a9622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:18.644688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac800542-2fb6-4b53-9db2-e492161a9622 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:18.659752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 968/1918] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:18.665067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b4d2d-b895-4523-b9d9-ff70ecb2c2da None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:18.676155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b4d2d-b895-4523-b9d9-ff70ecb2c2da None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:18.681122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbc581-cdf3-4f69-8363-afe23f868dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:18.681762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc581-cdf3-4f69-8363-afe23f868dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.682046 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc581-cdf3-4f69-8363-afe23f868dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.682377 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc581-cdf3-4f69-8363-afe23f868dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.683030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbc581-cdf3-4f69-8363-afe23f868dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:18.684971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbc581-cdf3-4f69-8363-afe23f868dd0 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:18.700705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:18.819548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 951/1919] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:18 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:18.820428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac800542-2fb6-4b53-9db2-e492161a9622 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:18.831386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac800542-2fb6-4b53-9db2-e492161a9622 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:18.850226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbc581-cdf3-4f69-8363-afe23f868dd0 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:18.853961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cedbc581-cdf3-4f69-8363-afe23f868dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:18.925544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58046bcb-5fc7-47dc-9712-6abb035b3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:18.927255 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58046bcb-5fc7-47dc-9712-6abb035b3e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.927601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58046bcb-5fc7-47dc-9712-6abb035b3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.927884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58046bcb-5fc7-47dc-9712-6abb035b3e38 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.928792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58046bcb-5fc7-47dc-9712-6abb035b3e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:18.931055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58046bcb-5fc7-47dc-9712-6abb035b3e38 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:18.940867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbc581-cdf3-4f69-8363-afe23f868dd0 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:18.946751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:18.947418 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.947703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.948184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] PATH_INFO: `/v3/projects/8ada7efca2554028ba340369669ad6bf` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.949311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ada7efca2554028ba340369669ad6bf)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:18.951349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.062438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 969/1920] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:18 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:19.063529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58046bcb-5fc7-47dc-9712-6abb035b3e38 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:19.074293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58046bcb-5fc7-47dc-9712-6abb035b3e38 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:19.079060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf8c6-ef14-47e3-bb44-64b2bda35e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:19.079672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf8c6-ef14-47e3-bb44-64b2bda35e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.079955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf8c6-ef14-47e3-bb44-64b2bda35e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.080309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf8c6-ef14-47e3-bb44-64b2bda35e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.081842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf8c6-ef14-47e3-bb44-64b2bda35e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:19.083834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf8c6-ef14-47e3-bb44-64b2bda35e98 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.098564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 970/1921] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:19.099952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf8c6-ef14-47e3-bb44-64b2bda35e98 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:19.106020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ada7efca2554028ba340369669ad6bf', 'request_id': 'req-22893a19-12bd-4a4d-90ff-cdc8352ec771'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:19.110142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf8c6-ef14-47e3-bb44-64b2bda35e98 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:19.167497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06966d-31dd-4473-8fa6-00ece172cb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:19.168151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06966d-31dd-4473-8fa6-00ece172cb89 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.168464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06966d-31dd-4473-8fa6-00ece172cb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.168776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06966d-31dd-4473-8fa6-00ece172cb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.169491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06966d-31dd-4473-8fa6-00ece172cb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:19.171650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06966d-31dd-4473-8fa6-00ece172cb89 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.182233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 971/1922] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:19.186137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06966d-31dd-4473-8fa6-00ece172cb89 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:19.194377 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:19.198772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06966d-31dd-4473-8fa6-00ece172cb89 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:19.203668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31229ddc-4df3-421c-9325-8fa28dc9b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:19.204265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31229ddc-4df3-421c-9325-8fa28dc9b420 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.204582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31229ddc-4df3-421c-9325-8fa28dc9b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.204863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31229ddc-4df3-421c-9325-8fa28dc9b420 admin admin] PATH_INFO: `/v3/projects/d9f73630a3b4449bbca7ae1f3e170295/users/3310bbca6df0438e9f6103a227713e13/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.219875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31229ddc-4df3-421c-9325-8fa28dc9b420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f73630a3b4449bbca7ae1f3e170295, user_id=3310bbca6df0438e9f6103a227713e13, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:19.222617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31229ddc-4df3-421c-9325-8fa28dc9b420 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.224652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ada7efca2554028ba340369669ad6bf', 'request_id': 'req-22893a19-12bd-4a4d-90ff-cdc8352ec771'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:19.231732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ada7efca2554028ba340369669ad6bf', 'request_id': 'req-22893a19-12bd-4a4d-90ff-cdc8352ec771'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:19.244073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] The token cache is being invalidate because project 8ada7efca2554028ba340369669ad6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:19.244367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:19.245044 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-22893a19-12bd-4a4d-90ff-cdc8352ec771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:19.246721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 952/1923] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:18 2022] DELETE /identity/v3/projects/8ada7efca2554028ba340369669ad6bf => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:19.251350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aac4de-d116-40e9-90aa-669a49d0df69 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.251636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aac4de-d116-40e9-90aa-669a49d0df69 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.251917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aac4de-d116-40e9-90aa-669a49d0df69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.271266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-97aac4de-d116-40e9-90aa-669a49d0df69 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:19.272481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-97aac4de-d116-40e9-90aa-669a49d0df69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:19.281496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 953/1924] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:19.290875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a26b8-0782-4dd0-abc0-eb9daef6ffe3 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.295722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a26b8-0782-4dd0-abc0-eb9daef6ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.295722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a26b8-0782-4dd0-abc0-eb9daef6ffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.312442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-2f7a26b8-0782-4dd0-abc0-eb9daef6ffe3 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:19.313603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2f7a26b8-0782-4dd0-abc0-eb9daef6ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:19.322073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 954/1925] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:19.331412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a26b8-0782-4dd0-abc0-eb9daef6ffe3 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:19.335029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 972/1926] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:19 2022] PUT /identity/v3/projects/d9f73630a3b4449bbca7ae1f3e170295/users/3310bbca6df0438e9f6103a227713e13/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:19.340570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657e1ba-fd81-4420-bea1-61f2dc1f9923 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.340930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657e1ba-fd81-4420-bea1-61f2dc1f9923 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.341469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657e1ba-fd81-4420-bea1-61f2dc1f9923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.341900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a26b8-0782-4dd0-abc0-eb9daef6ffe3 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:19.361314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1657e1ba-fd81-4420-bea1-61f2dc1f9923 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:19.362992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1657e1ba-fd81-4420-bea1-61f2dc1f9923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:19.407959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bba2b-eea5-47f0-97b4-324756518935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:19.416066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bba2b-eea5-47f0-97b4-324756518935 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.416066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bba2b-eea5-47f0-97b4-324756518935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.416066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bba2b-eea5-47f0-97b4-324756518935 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.416066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bba2b-eea5-47f0-97b4-324756518935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:19.416066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bba2b-eea5-47f0-97b4-324756518935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:19.416066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bba2b-eea5-47f0-97b4-324756518935 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.423983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 955/1927] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:48:19.429750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bba2b-eea5-47f0-97b4-324756518935 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:19.437475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 973/1928] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:19.440460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bba2b-eea5-47f0-97b4-324756518935 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:19.448295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657e1ba-fd81-4420-bea1-61f2dc1f9923 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:19.449066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e14f6-e80b-4ced-bf45-a323b47aee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:19.449680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1657e1ba-fd81-4420-bea1-61f2dc1f9923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:19.449879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e14f6-e80b-4ced-bf45-a323b47aee00 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.450169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e14f6-e80b-4ced-bf45-a323b47aee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.451624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e14f6-e80b-4ced-bf45-a323b47aee00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.451624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e14f6-e80b-4ced-bf45-a323b47aee00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:19.453233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e14f6-e80b-4ced-bf45-a323b47aee00 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.511064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657e1ba-fd81-4420-bea1-61f2dc1f9923 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:19.514791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f6f46-ca2c-4333-a4f6-cab5039f5d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:19.515414 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f6f46-ca2c-4333-a4f6-cab5039f5d94 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.515700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f6f46-ca2c-4333-a4f6-cab5039f5d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.515975 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f6f46-ca2c-4333-a4f6-cab5039f5d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.525197 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f6f46-ca2c-4333-a4f6-cab5039f5d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:19.526668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f6f46-ca2c-4333-a4f6-cab5039f5d94 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.536793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 974/1929] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:19.542214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 956/1930] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:19 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:19.546957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f6f46-ca2c-4333-a4f6-cab5039f5d94 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:19.560840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f6f46-ca2c-4333-a4f6-cab5039f5d94 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:19.620176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d361b9-494b-4993-a825-219eeeb6bdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:19.620889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d361b9-494b-4993-a825-219eeeb6bdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.621277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d361b9-494b-4993-a825-219eeeb6bdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.621635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d361b9-494b-4993-a825-219eeeb6bdf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.622416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d361b9-494b-4993-a825-219eeeb6bdf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:19.624840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d361b9-494b-4993-a825-219eeeb6bdf1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.732157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 975/1931] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:19 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:19.733676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e14f6-e80b-4ced-bf45-a323b47aee00 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:19.745030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e14f6-e80b-4ced-bf45-a323b47aee00 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:19.750050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4da6-6398-468c-9372-23660a6fa7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:19.750907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4da6-6398-468c-9372-23660a6fa7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.751245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4da6-6398-468c-9372-23660a6fa7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.751525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4da6-6398-468c-9372-23660a6fa7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.752174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec4da6-6398-468c-9372-23660a6fa7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:19.753846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec4da6-6398-468c-9372-23660a6fa7e8 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.764740 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 957/1932] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:19.768962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d361b9-494b-4993-a825-219eeeb6bdf1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:19.779922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d361b9-494b-4993-a825-219eeeb6bdf1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:19.784498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69fd40-fa17-4f3c-9cbd-66417843a02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:19.785131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69fd40-fa17-4f3c-9cbd-66417843a02b admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.785413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69fd40-fa17-4f3c-9cbd-66417843a02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.785687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69fd40-fa17-4f3c-9cbd-66417843a02b admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.786357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69fd40-fa17-4f3c-9cbd-66417843a02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:19.787957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69fd40-fa17-4f3c-9cbd-66417843a02b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.798222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 976/1933] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:19.802315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4da6-6398-468c-9372-23660a6fa7e8 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:19.813279 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4da6-6398-468c-9372-23660a6fa7e8 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:19.817820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8b24b-f40b-4a1f-8a3e-35bc2ca92a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:19.818502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8b24b-f40b-4a1f-8a3e-35bc2ca92a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.818786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8b24b-f40b-4a1f-8a3e-35bc2ca92a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.819060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8b24b-f40b-4a1f-8a3e-35bc2ca92a52 admin admin] PATH_INFO: `/v3/projects/99d588b9cca24777a736ff57fdab3197/users/28340e9fea4349d18f21b253927caa49/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.831320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:19.837659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8b24b-f40b-4a1f-8a3e-35bc2ca92a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d588b9cca24777a736ff57fdab3197, user_id=28340e9fea4349d18f21b253927caa49, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:19.840343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8b24b-f40b-4a1f-8a3e-35bc2ca92a52 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:19.968987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 958/1934] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:19 2022] PUT /identity/v3/projects/99d588b9cca24777a736ff57fdab3197/users/28340e9fea4349d18f21b253927caa49/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:19.980229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b90e-972b-498b-9d5e-770bcb316a9c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.980586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b90e-972b-498b-9d5e-770bcb316a9c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.980938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b90e-972b-498b-9d5e-770bcb316a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:20.026743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ee57b90e-972b-498b-9d5e-770bcb316a9c None None] MFA Rules not processed for user `28340e9fea4349d18f21b253927caa49`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:20.028364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ee57b90e-972b-498b-9d5e-770bcb316a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:20.130064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 977/1935] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:20.130595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8b24b-f40b-4a1f-8a3e-35bc2ca92a52 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:20.231895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8b24b-f40b-4a1f-8a3e-35bc2ca92a52 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:20.238155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4fa93-e1ad-41b8-8f72-52a796c41a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:20.238892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4fa93-e1ad-41b8-8f72-52a796c41a5d admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:20.239841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4fa93-e1ad-41b8-8f72-52a796c41a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:20.240355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4fa93-e1ad-41b8-8f72-52a796c41a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:20.241077 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4fa93-e1ad-41b8-8f72-52a796c41a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:20.243839 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4fa93-e1ad-41b8-8f72-52a796c41a5d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:20.354620 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 959/1936] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:20 2022] POST /identity/v3/projects => generated 379 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:20.360981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b90e-972b-498b-9d5e-770bcb316a9c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:20.371040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b90e-972b-498b-9d5e-770bcb316a9c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:20.442332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:20.471577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dc4dc-1876-4950-baff-3cce353f3e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:20.476484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dc4dc-1876-4950-baff-3cce353f3e39 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:20.476484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dc4dc-1876-4950-baff-3cce353f3e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:20.476484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dc4dc-1876-4950-baff-3cce353f3e39 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:20.476484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dc4dc-1876-4950-baff-3cce353f3e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:20.479184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dc4dc-1876-4950-baff-3cce353f3e39 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:20.603398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 978/1937] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:20 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:20.607960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4fa93-e1ad-41b8-8f72-52a796c41a5d admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:20.618412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4fa93-e1ad-41b8-8f72-52a796c41a5d admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:20.623280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41d9e6-0afe-4524-811b-62e279e01b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:20.623981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41d9e6-0afe-4524-811b-62e279e01b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:20.624296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41d9e6-0afe-4524-811b-62e279e01b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:20.624575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41d9e6-0afe-4524-811b-62e279e01b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:20.625303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41d9e6-0afe-4524-811b-62e279e01b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:20.627038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41d9e6-0afe-4524-811b-62e279e01b47 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:20.639013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 960/1938] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:20.643117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dc4dc-1876-4950-baff-3cce353f3e39 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:20.654384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dc4dc-1876-4950-baff-3cce353f3e39 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:20.660151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b636703-9379-4fa3-9fd0-113e01e669de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:20.660151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b636703-9379-4fa3-9fd0-113e01e669de admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:20.660376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b636703-9379-4fa3-9fd0-113e01e669de admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:20.660756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b636703-9379-4fa3-9fd0-113e01e669de admin admin] PATH_INFO: `/v3/projects/98255457098146bb919d9938398e0106/users/febeac517f884018ae90f0c1c9ff1fb0/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:20.680929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b636703-9379-4fa3-9fd0-113e01e669de admin admin] RBAC: Authorizing `identity:create_grant(project_id=98255457098146bb919d9938398e0106, user_id=febeac517f884018ae90f0c1c9ff1fb0, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:20.685453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b636703-9379-4fa3-9fd0-113e01e669de admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:20.802913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 979/1939] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:20 2022] PUT /identity/v3/projects/98255457098146bb919d9938398e0106/users/febeac517f884018ae90f0c1c9ff1fb0/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:20.807380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41d9e6-0afe-4524-811b-62e279e01b47 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:20.818393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41d9e6-0afe-4524-811b-62e279e01b47 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:20.902770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d061f1-597f-4154-a275-edbf40ba76aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:20.903586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d061f1-597f-4154-a275-edbf40ba76aa admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:20.904374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d061f1-597f-4154-a275-edbf40ba76aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:20.904374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d061f1-597f-4154-a275-edbf40ba76aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:20.905172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d061f1-597f-4154-a275-edbf40ba76aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:20.907085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d061f1-597f-4154-a275-edbf40ba76aa admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:20.911179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:20.919645 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 961/1940] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:20.923681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b636703-9379-4fa3-9fd0-113e01e669de admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:20.935122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b636703-9379-4fa3-9fd0-113e01e669de admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:20.940327 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87833375-176b-48fb-9288-04e20fdca10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:20.941002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87833375-176b-48fb-9288-04e20fdca10c admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:20.941904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87833375-176b-48fb-9288-04e20fdca10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:20.941904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87833375-176b-48fb-9288-04e20fdca10c admin admin] PATH_INFO: `/v3/projects/98255457098146bb919d9938398e0106/users/febeac517f884018ae90f0c1c9ff1fb0/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:20.943853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87833375-176b-48fb-9288-04e20fdca10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98255457098146bb919d9938398e0106, user_id=febeac517f884018ae90f0c1c9ff1fb0, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:20.947057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87833375-176b-48fb-9288-04e20fdca10c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:20.959762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 980/1941] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:20 2022] PUT /identity/v3/projects/98255457098146bb919d9938398e0106/users/febeac517f884018ae90f0c1c9ff1fb0/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:20.971826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a2d00-1c16-4942-bc93-c22a2e75e940 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:20.972143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a2d00-1c16-4942-bc93-c22a2e75e940 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:20.972478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a2d00-1c16-4942-bc93-c22a2e75e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:21.006527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-8a7a2d00-1c16-4942-bc93-c22a2e75e940 None None] MFA Rules not processed for user `febeac517f884018ae90f0c1c9ff1fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:21.008063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8a7a2d00-1c16-4942-bc93-c22a2e75e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:21.085760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8298b-2010-4d91-96d2-eebd1e3f9488 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:21.085760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8298b-2010-4d91-96d2-eebd1e3f9488 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:21.085760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8298b-2010-4d91-96d2-eebd1e3f9488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:21.122232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 962/1942] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:21.132927 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a2d00-1c16-4942-bc93-c22a2e75e940 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:21.134932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8a7a2d00-1c16-4942-bc93-c22a2e75e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:21.136251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-68e8298b-2010-4d91-96d2-eebd1e3f9488 None None] MFA Rules not processed for user `3310bbca6df0438e9f6103a227713e13`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:21.137718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-68e8298b-2010-4d91-96d2-eebd1e3f9488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:21.207123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a2d00-1c16-4942-bc93-c22a2e75e940 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:21.212272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3849a-c7bd-475a-ac36-079cc8e229d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:21.212886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3849a-c7bd-475a-ac36-079cc8e229d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:21.213166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3849a-c7bd-475a-ac36-079cc8e229d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:21.213461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3849a-c7bd-475a-ac36-079cc8e229d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:21.223975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3849a-c7bd-475a-ac36-079cc8e229d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:21.225407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3849a-c7bd-475a-ac36-079cc8e229d6 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:21.235431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 963/1943] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:21.252705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 981/1944] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:21.263893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3849a-c7bd-475a-ac36-079cc8e229d6 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:21.265349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-dbf3849a-c7bd-475a-ac36-079cc8e229d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:21.277232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3849a-c7bd-475a-ac36-079cc8e229d6 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:21.285793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5aa3d-4032-42dd-a13e-3f99a9bb5501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:21.285793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5aa3d-4032-42dd-a13e-3f99a9bb5501 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:21.285793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5aa3d-4032-42dd-a13e-3f99a9bb5501 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:21.285793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5aa3d-4032-42dd-a13e-3f99a9bb5501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:21.300229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5aa3d-4032-42dd-a13e-3f99a9bb5501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:21.301591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5aa3d-4032-42dd-a13e-3f99a9bb5501 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:21.317679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 964/1945] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:21.597361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:21.936778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8298b-2010-4d91-96d2-eebd1e3f9488 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:21.955042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5aa3d-4032-42dd-a13e-3f99a9bb5501 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:21.957014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2ab5aa3d-4032-42dd-a13e-3f99a9bb5501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:22.003992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8298b-2010-4d91-96d2-eebd1e3f9488 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:22.010528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:22.011937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:22.012099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:22.012352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] PATH_INFO: `/v3/users/28340e9fea4349d18f21b253927caa49` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:22.013949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28340e9fea4349d18f21b253927caa49)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:22.016029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:22.032935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5aa3d-4032-42dd-a13e-3f99a9bb5501 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:22.040392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:22.041052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:22.041338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:22.041614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] PATH_INFO: `/v3/users/ad428001b0574dd39f83312fc87dce0f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:22.043509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad428001b0574dd39f83312fc87dce0f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:22.047243 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:22.296600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28340e9fea4349d18f21b253927caa49'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.297251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28340e9fea4349d18f21b253927caa49'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.304890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28340e9fea4349d18f21b253927caa49'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.317229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28340e9fea4349d18f21b253927caa49'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.402025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6bfc346f-25e1-4e6f-bd06-818af105c868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28340e9fea4349d18f21b253927caa49'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.409499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 982/1946] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:21 2022] DELETE /identity/v3/users/28340e9fea4349d18f21b253927caa49 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:22.415055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419f0a0-7cfd-49ad-90e0-a804c756814e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:22.415584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419f0a0-7cfd-49ad-90e0-a804c756814e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:22.416174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419f0a0-7cfd-49ad-90e0-a804c756814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:22.422322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:22.424197 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad428001b0574dd39f83312fc87dce0f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.442842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad428001b0574dd39f83312fc87dce0f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.448659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3419f0a0-7cfd-49ad-90e0-a804c756814e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:22.450127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3419f0a0-7cfd-49ad-90e0-a804c756814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:22.493941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:22.527933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad428001b0574dd39f83312fc87dce0f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.530862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 983/1947] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:22.536681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad428001b0574dd39f83312fc87dce0f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.537854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f9b74da5-b34c-4f34-aa96-ecde374e8649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad428001b0574dd39f83312fc87dce0f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.543458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419f0a0-7cfd-49ad-90e0-a804c756814e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:22.552253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3419f0a0-7cfd-49ad-90e0-a804c756814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:22.553422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 965/1948] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:21 2022] DELETE /identity/v3/users/ad428001b0574dd39f83312fc87dce0f => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:22.558102 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04805605-87aa-4444-8b34-55228763fdf6 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:22.558879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04805605-87aa-4444-8b34-55228763fdf6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:22.559537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04805605-87aa-4444-8b34-55228763fdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:22.594681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-04805605-87aa-4444-8b34-55228763fdf6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:22.596914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-04805605-87aa-4444-8b34-55228763fdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:22.651439 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419f0a0-7cfd-49ad-90e0-a804c756814e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:22.697652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 966/1949] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:22.718294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04805605-87aa-4444-8b34-55228763fdf6 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:22.721060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-04805605-87aa-4444-8b34-55228763fdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:22.743200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3cb42-a230-4ee8-b491-7bd2affeb141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:22.744514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3cb42-a230-4ee8-b491-7bd2affeb141 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:22.744991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3cb42-a230-4ee8-b491-7bd2affeb141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:22.746510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3cb42-a230-4ee8-b491-7bd2affeb141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:22.749727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c6a3cb42-a230-4ee8-b491-7bd2affeb141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:22.764457 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3cb42-a230-4ee8-b491-7bd2affeb141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:22.765927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3cb42-a230-4ee8-b491-7bd2affeb141 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:22.777202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 984/1950] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:22.813091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04805605-87aa-4444-8b34-55228763fdf6 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:22.817719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709418-2352-46f4-84e7-e4f416875c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:22.818867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709418-2352-46f4-84e7-e4f416875c57 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:22.819331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709418-2352-46f4-84e7-e4f416875c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:22.820569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709418-2352-46f4-84e7-e4f416875c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:22.831710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a709418-2352-46f4-84e7-e4f416875c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:22.834082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a709418-2352-46f4-84e7-e4f416875c57 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:22.846131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 967/1951] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:23.309547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48d8da-758a-4cf0-bbee-c89f5ab7d94b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:23.310070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48d8da-758a-4cf0-bbee-c89f5ab7d94b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:23.310254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48d8da-758a-4cf0-bbee-c89f5ab7d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:23.330801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3e48d8da-758a-4cf0-bbee-c89f5ab7d94b None None] MFA Rules not processed for user `3310bbca6df0438e9f6103a227713e13`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:23.332117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3e48d8da-758a-4cf0-bbee-c89f5ab7d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:23.392815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 985/1952] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:23.431772 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709418-2352-46f4-84e7-e4f416875c57 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:23.433255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2a709418-2352-46f4-84e7-e4f416875c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:23.446745 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709418-2352-46f4-84e7-e4f416875c57 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:23.451737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:23.452647 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:23.452902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:23.453176 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] PATH_INFO: `/v3/users/a35e0c8f7cb749de8dab38796c029bf0` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:23.454449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35e0c8f7cb749de8dab38796c029bf0)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:23.456363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:23.573188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48d8da-758a-4cf0-bbee-c89f5ab7d94b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:23.574752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3e48d8da-758a-4cf0-bbee-c89f5ab7d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:23.590112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48d8da-758a-4cf0-bbee-c89f5ab7d94b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:23.594824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:23.595520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:23.595804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:23.596082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] PATH_INFO: `/v3/projects/99d588b9cca24777a736ff57fdab3197` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:23.597213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d588b9cca24777a736ff57fdab3197)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:23.599164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:23.731230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35e0c8f7cb749de8dab38796c029bf0'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.752625 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35e0c8f7cb749de8dab38796c029bf0'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.768766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d588b9cca24777a736ff57fdab3197', 'request_id': 'req-33790ac7-5d96-4f3e-81e2-dc8270091bf0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.776411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d588b9cca24777a736ff57fdab3197', 'request_id': 'req-33790ac7-5d96-4f3e-81e2-dc8270091bf0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.842310 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35e0c8f7cb749de8dab38796c029bf0'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.850294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35e0c8f7cb749de8dab38796c029bf0'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.851214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35e0c8f7cb749de8dab38796c029bf0'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.857471 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 968/1953] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:23 2022] DELETE /identity/v3/users/a35e0c8f7cb749de8dab38796c029bf0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:23.858509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:23.859851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:23.916664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d588b9cca24777a736ff57fdab3197', 'request_id': 'req-33790ac7-5d96-4f3e-81e2-dc8270091bf0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.932913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] The token cache is being invalidate because project 99d588b9cca24777a736ff57fdab3197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:23.933605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.935104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.938860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d606f9-280b-44a5-9c1b-20a1b5763de0 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:23.940308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 986/1954] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:23 2022] DELETE /identity/v3/projects/99d588b9cca24777a736ff57fdab3197 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:23.941919 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:23.943552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:23.944690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:23.946721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:23.947012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:23.954018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] PATH_INFO: `/v3/projects/2429b3f6a4094940902373b8496abfbd` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:23.954018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2429b3f6a4094940902373b8496abfbd)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:23.954018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:24.029787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33790ac7-5d96-4f3e-81e2-dc8270091bf0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:24.041354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:24.041354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:24.041354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:24.041354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] PATH_INFO: `/v3/users/febeac517f884018ae90f0c1c9ff1fb0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:24.041746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=febeac517f884018ae90f0c1c9ff1fb0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:24.041746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:24.083149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2429b3f6a4094940902373b8496abfbd', 'request_id': 'req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.093461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:24.169272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=6 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:24.175784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2429b3f6a4094940902373b8496abfbd', 'request_id': 'req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.184516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2429b3f6a4094940902373b8496abfbd', 'request_id': 'req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.198483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] The token cache is being invalidate because project 2429b3f6a4094940902373b8496abfbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:24.198847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.199685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.201281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 969/1955] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:23 2022] DELETE /identity/v3/projects/2429b3f6a4094940902373b8496abfbd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:24.205588 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:24.207953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:24.272221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b70f64-fb91-4af5-b3ed-9ad9ba36e299 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:24.277603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:24.278266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:24.278554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:24.278835 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] PATH_INFO: `/v3/projects/425a68e8750a4c9b8b1ce76c761010ca` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:24.279938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=425a68e8750a4c9b8b1ce76c761010ca)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:24.281947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:24.318275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febeac517f884018ae90f0c1c9ff1fb0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.318918 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febeac517f884018ae90f0c1c9ff1fb0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.326449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febeac517f884018ae90f0c1c9ff1fb0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.339203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febeac517f884018ae90f0c1c9ff1fb0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.401927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febeac517f884018ae90f0c1c9ff1fb0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.410032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 987/1956] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:23 2022] DELETE /identity/v3/users/febeac517f884018ae90f0c1c9ff1fb0 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:24.410962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:24.412440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:24.437684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425a68e8750a4c9b8b1ce76c761010ca', 'request_id': 'req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.496437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea655a-e7af-4389-b423-482dd2dea6cc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:24.502847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425a68e8750a4c9b8b1ce76c761010ca', 'request_id': 'req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.528691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425a68e8750a4c9b8b1ce76c761010ca', 'request_id': 'req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.545006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] The token cache is being invalidate because project 425a68e8750a4c9b8b1ce76c761010ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:24.545115 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.545809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3b1d8e02-7b51-4765-a7df-0e3bd9def55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.552169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 970/1957] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:24 2022] DELETE /identity/v3/projects/425a68e8750a4c9b8b1ce76c761010ca => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:24.553730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221f72-697a-4384-a125-6e5ea11ad1ed None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:24.554149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221f72-697a-4384-a125-6e5ea11ad1ed None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:24.554469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221f72-697a-4384-a125-6e5ea11ad1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:24.581635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a5221f72-697a-4384-a125-6e5ea11ad1ed None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:24.583177 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a5221f72-697a-4384-a125-6e5ea11ad1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:24.583785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:24.584348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:24.584725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:24.584988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] PATH_INFO: `/v3/users/2ffd2e91b96f4f08b302e2e81bbdc06b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:24.587196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ffd2e91b96f4f08b302e2e81bbdc06b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:24.589492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:24.592293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 971/1958] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:24.601113 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76af313-4723-4c07-a8fe-7aff23c946ba None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:24.601423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76af313-4723-4c07-a8fe-7aff23c946ba None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:24.601679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76af313-4723-4c07-a8fe-7aff23c946ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:24.624238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c76af313-4723-4c07-a8fe-7aff23c946ba None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:24.625429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c76af313-4723-4c07-a8fe-7aff23c946ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:24.633884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 972/1959] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:24.638240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76af313-4723-4c07-a8fe-7aff23c946ba None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:24.647650 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76af313-4723-4c07-a8fe-7aff23c946ba None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:24.652537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f540191-da0b-4cb0-9301-60d2e070f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:24.653139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f540191-da0b-4cb0-9301-60d2e070f701 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:24.653420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f540191-da0b-4cb0-9301-60d2e070f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:24.653693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f540191-da0b-4cb0-9301-60d2e070f701 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:24.654406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f540191-da0b-4cb0-9301-60d2e070f701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:24.654709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f540191-da0b-4cb0-9301-60d2e070f701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:24.656323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f540191-da0b-4cb0-9301-60d2e070f701 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:24.671584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 973/1960] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:24.672466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f540191-da0b-4cb0-9301-60d2e070f701 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:24.682780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f540191-da0b-4cb0-9301-60d2e070f701 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:24.687490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c842e-e178-4073-98ea-dbca9709ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:24.690457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c842e-e178-4073-98ea-dbca9709ab9f admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:24.690457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c842e-e178-4073-98ea-dbca9709ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:24.690457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c842e-e178-4073-98ea-dbca9709ab9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:24.690457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c842e-e178-4073-98ea-dbca9709ab9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:24.692075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c842e-e178-4073-98ea-dbca9709ab9f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:24.818694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 974/1961] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:24 2022] POST /identity/v3/projects => generated 405 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:24.823625 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c842e-e178-4073-98ea-dbca9709ab9f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:24.883537 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c842e-e178-4073-98ea-dbca9709ab9f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:24.888166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784a1c-c9e3-4344-91b7-89c01d505eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:24.888788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784a1c-c9e3-4344-91b7-89c01d505eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:24.889114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784a1c-c9e3-4344-91b7-89c01d505eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:24.889425 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784a1c-c9e3-4344-91b7-89c01d505eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:24.890069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37784a1c-c9e3-4344-91b7-89c01d505eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:24.892054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37784a1c-c9e3-4344-91b7-89c01d505eb9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:24.902162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ffd2e91b96f4f08b302e2e81bbdc06b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.902981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ffd2e91b96f4f08b302e2e81bbdc06b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.910118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ffd2e91b96f4f08b302e2e81bbdc06b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.923005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ffd2e91b96f4f08b302e2e81bbdc06b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.042052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ffd2e91b96f4f08b302e2e81bbdc06b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.043405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 975/1962] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:24 2022] POST /identity/v3/users => generated 303 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:25.043405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784a1c-c9e3-4344-91b7-89c01d505eb9 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.046783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-37784a1c-c9e3-4344-91b7-89c01d505eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.052922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 988/1963] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:24 2022] DELETE /identity/v3/users/2ffd2e91b96f4f08b302e2e81bbdc06b => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:25.052922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.063078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784a1c-c9e3-4344-91b7-89c01d505eb9 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.063548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.133963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.134648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.134936 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.135217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] PATH_INFO: `/v3/projects/98255457098146bb919d9938398e0106` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.136748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=98255457098146bb919d9938398e0106)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.138717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.146741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc71182-5a96-47a8-a749-819e8f6cc278 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.152768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621d171-ebb6-41bc-b572-5c3cf2e62d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.153456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621d171-ebb6-41bc-b572-5c3cf2e62d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.153998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621d171-ebb6-41bc-b572-5c3cf2e62d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.153998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621d171-ebb6-41bc-b572-5c3cf2e62d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.155218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621d171-ebb6-41bc-b572-5c3cf2e62d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.156871 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621d171-ebb6-41bc-b572-5c3cf2e62d84 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.172262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 989/1964] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:25.172681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621d171-ebb6-41bc-b572-5c3cf2e62d84 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.182902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621d171-ebb6-41bc-b572-5c3cf2e62d84 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.187422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:25.189750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11a8f-8cd2-4a28-8676-c7601a5fecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.190393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11a8f-8cd2-4a28-8676-c7601a5fecd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.190680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11a8f-8cd2-4a28-8676-c7601a5fecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.190955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11a8f-8cd2-4a28-8676-c7601a5fecd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.191635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa11a8f-8cd2-4a28-8676-c7601a5fecd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.193247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa11a8f-8cd2-4a28-8676-c7601a5fecd4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.204376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 990/1965] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:25.208607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11a8f-8cd2-4a28-8676-c7601a5fecd4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.219286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11a8f-8cd2-4a28-8676-c7601a5fecd4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.224865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f407b-c929-4b74-b435-2de61f52d299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.224865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f407b-c929-4b74-b435-2de61f52d299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.225351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f407b-c929-4b74-b435-2de61f52d299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.225607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f407b-c929-4b74-b435-2de61f52d299 admin admin] PATH_INFO: `/v3/projects/93e063d809ec49199fd7c373589d5ce2/users/642415aac7c141d9a1ac96bd879f240a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.242329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f407b-c929-4b74-b435-2de61f52d299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e063d809ec49199fd7c373589d5ce2, user_id=642415aac7c141d9a1ac96bd879f240a, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.245078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f407b-c929-4b74-b435-2de61f52d299 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.363080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 991/1966] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:25 2022] PUT /identity/v3/projects/93e063d809ec49199fd7c373589d5ce2/users/642415aac7c141d9a1ac96bd879f240a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:25.370939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98255457098146bb919d9938398e0106', 'request_id': 'req-0aad93f7-4602-4909-a7a3-a5246e67aafc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.373796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60c2ba-adf2-4d96-89de-05932e008b79 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.374087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60c2ba-adf2-4d96-89de-05932e008b79 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.374396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60c2ba-adf2-4d96-89de-05932e008b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.408086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-bf60c2ba-adf2-4d96-89de-05932e008b79 None None] MFA Rules not processed for user `642415aac7c141d9a1ac96bd879f240a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:25.409324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bf60c2ba-adf2-4d96-89de-05932e008b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.464966 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98255457098146bb919d9938398e0106', 'request_id': 'req-0aad93f7-4602-4909-a7a3-a5246e67aafc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.472345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98255457098146bb919d9938398e0106', 'request_id': 'req-0aad93f7-4602-4909-a7a3-a5246e67aafc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.483198 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 992/1967] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:25.484819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] The token cache is being invalidate because project 98255457098146bb919d9938398e0106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:25.485118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.485791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0aad93f7-4602-4909-a7a3-a5246e67aafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.487380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 976/1968] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:25 2022] DELETE /identity/v3/projects/98255457098146bb919d9938398e0106 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:25.488188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60c2ba-adf2-4d96-89de-05932e008b79 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.492705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d127b0-de6c-495a-8235-b0b639467cf0 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.493141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d127b0-de6c-495a-8235-b0b639467cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.493453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d127b0-de6c-495a-8235-b0b639467cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.513729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c9d127b0-de6c-495a-8235-b0b639467cf0 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:25.515059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c9d127b0-de6c-495a-8235-b0b639467cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.556563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60c2ba-adf2-4d96-89de-05932e008b79 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.561285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cf088-1e4f-47c0-b9bb-29e7e115f74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.561921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf088-1e4f-47c0-b9bb-29e7e115f74f admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.562238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf088-1e4f-47c0-b9bb-29e7e115f74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.562495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf088-1e4f-47c0-b9bb-29e7e115f74f admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.564699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cf088-1e4f-47c0-b9bb-29e7e115f74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.565365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cf088-1e4f-47c0-b9bb-29e7e115f74f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.580064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 977/1969] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:25.580735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d127b0-de6c-495a-8235-b0b639467cf0 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.582012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c9d127b0-de6c-495a-8235-b0b639467cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.597701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d127b0-de6c-495a-8235-b0b639467cf0 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.603586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.604333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.604677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.605029 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] PATH_INFO: `/v3/projects/70fe8ffb6269473dbb6596b059120641` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.606356 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fe8ffb6269473dbb6596b059120641)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.608331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.673867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 993/1970] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/projects => generated 405 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:25.675212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eb8c8-fdb4-4fd4-9341-a0bd12635fac None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.675501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eb8c8-fdb4-4fd4-9341-a0bd12635fac None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.675781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eb8c8-fdb4-4fd4-9341-a0bd12635fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.695216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-bb1eb8c8-fdb4-4fd4-9341-a0bd12635fac None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:25.696499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bb1eb8c8-fdb4-4fd4-9341-a0bd12635fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.755103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 994/1971] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:25.756106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eb8c8-fdb4-4fd4-9341-a0bd12635fac None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.757965 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bb1eb8c8-fdb4-4fd4-9341-a0bd12635fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.769876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eb8c8-fdb4-4fd4-9341-a0bd12635fac None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.771015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fe8ffb6269473dbb6596b059120641', 'request_id': 'req-9af6a001-4f61-4683-981e-2c041dc571d7'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.826974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9305d6-d3ab-4fc3-a5e7-c6fb289f050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.827609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9305d6-d3ab-4fc3-a5e7-c6fb289f050e admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.827897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9305d6-d3ab-4fc3-a5e7-c6fb289f050e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.828172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9305d6-d3ab-4fc3-a5e7-c6fb289f050e admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.828851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9305d6-d3ab-4fc3-a5e7-c6fb289f050e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.830921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9305d6-d3ab-4fc3-a5e7-c6fb289f050e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.899814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fe8ffb6269473dbb6596b059120641', 'request_id': 'req-9af6a001-4f61-4683-981e-2c041dc571d7'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.906025 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fe8ffb6269473dbb6596b059120641', 'request_id': 'req-9af6a001-4f61-4683-981e-2c041dc571d7'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.917813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] The token cache is being invalidate because project 70fe8ffb6269473dbb6596b059120641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:25.918111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.918818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.920415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 978/1972] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:25 2022] DELETE /identity/v3/projects/70fe8ffb6269473dbb6596b059120641 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:25.921193 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.922501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.933727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 995/1973] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/users => generated 309 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:25.935194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a001-4f61-4683-981e-2c041dc571d7 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.948878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e81a0-638c-4c66-afbc-c9eea68fdcf1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.948878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e81a0-638c-4c66-afbc-c9eea68fdcf1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.948878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e81a0-638c-4c66-afbc-c9eea68fdcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.949129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d87b2-b139-4c42-b3dc-f791c56e5ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.949129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d87b2-b139-4c42-b3dc-f791c56e5ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.949129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d87b2-b139-4c42-b3dc-f791c56e5ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.949129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d87b2-b139-4c42-b3dc-f791c56e5ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.949426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d87b2-b139-4c42-b3dc-f791c56e5ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:25.949426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d87b2-b139-4c42-b3dc-f791c56e5ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.949426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d87b2-b139-4c42-b3dc-f791c56e5ae1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.955414 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2c7e81a0-638c-4c66-afbc-c9eea68fdcf1 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:25.956622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2c7e81a0-638c-4c66-afbc-c9eea68fdcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.956743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 979/1974] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:25.957580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d87b2-b139-4c42-b3dc-f791c56e5ae1 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.959521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-fe0d87b2-b139-4c42-b3dc-f791c56e5ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.965916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 996/1975] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:25.966650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e81a0-638c-4c66-afbc-c9eea68fdcf1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.976818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e81a0-638c-4c66-afbc-c9eea68fdcf1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.978331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d87b2-b139-4c42-b3dc-f791c56e5ae1 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.981410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485aee5-0e04-411d-b102-170511604921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.982016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485aee5-0e04-411d-b102-170511604921 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.982329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485aee5-0e04-411d-b102-170511604921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.982605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485aee5-0e04-411d-b102-170511604921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.983220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485aee5-0e04-411d-b102-170511604921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.983371 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06af077-b016-4a4a-9e74-e862e2a47597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.988792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06af077-b016-4a4a-9e74-e862e2a47597 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.988792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06af077-b016-4a4a-9e74-e862e2a47597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.988792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06af077-b016-4a4a-9e74-e862e2a47597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.989009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485aee5-0e04-411d-b102-170511604921 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.989106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06af077-b016-4a4a-9e74-e862e2a47597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.989106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06af077-b016-4a4a-9e74-e862e2a47597 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.997848 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 980/1976] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:25.999102 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca654b-dc90-434d-b129-9cb889fe44ea None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.999391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca654b-dc90-434d-b129-9cb889fe44ea None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.999687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca654b-dc90-434d-b129-9cb889fe44ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.019559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-34ca654b-dc90-434d-b129-9cb889fe44ea None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:26.020784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-34ca654b-dc90-434d-b129-9cb889fe44ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:26.029887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 981/1977] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:26.031002 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca654b-dc90-434d-b129-9cb889fe44ea None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.040646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca654b-dc90-434d-b129-9cb889fe44ea None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.045269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866fc98-24d5-4b9e-aabd-e731a50d190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.045915 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866fc98-24d5-4b9e-aabd-e731a50d190b admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.046215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866fc98-24d5-4b9e-aabd-e731a50d190b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.046579 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866fc98-24d5-4b9e-aabd-e731a50d190b admin admin] PATH_INFO: `/v3/projects/3f0d10d8abf6418f9969079b38f99c09/users/76690e57c8af41cd97305c9b25f30961/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.061720 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866fc98-24d5-4b9e-aabd-e731a50d190b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0d10d8abf6418f9969079b38f99c09, user_id=76690e57c8af41cd97305c9b25f30961, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.064441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866fc98-24d5-4b9e-aabd-e731a50d190b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.073124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 997/1978] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:26.074168 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485aee5-0e04-411d-b102-170511604921 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.094250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:26.136477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485aee5-0e04-411d-b102-170511604921 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.141096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fb307-79e4-4383-af8f-4dfc152bd8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.141699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fb307-79e4-4383-af8f-4dfc152bd8af admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.141977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fb307-79e4-4383-af8f-4dfc152bd8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.142283 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fb307-79e4-4383-af8f-4dfc152bd8af admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.142969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fb307-79e4-4383-af8f-4dfc152bd8af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:26.143273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fb307-79e4-4383-af8f-4dfc152bd8af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.145310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fb307-79e4-4383-af8f-4dfc152bd8af admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.157624 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 998/1979] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:26.158442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fb307-79e4-4383-af8f-4dfc152bd8af admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.168036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fb307-79e4-4383-af8f-4dfc152bd8af admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.178382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d02c2-76be-4160-b9dd-88f917836c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.178382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d02c2-76be-4160-b9dd-88f917836c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.178382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d02c2-76be-4160-b9dd-88f917836c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.178382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d02c2-76be-4160-b9dd-88f917836c41 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.180041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d02c2-76be-4160-b9dd-88f917836c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.180041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d02c2-76be-4160-b9dd-88f917836c41 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.236382 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 982/1980] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:26 2022] PUT /identity/v3/projects/3f0d10d8abf6418f9969079b38f99c09/users/76690e57c8af41cd97305c9b25f30961/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:26.236382 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866fc98-24d5-4b9e-aabd-e731a50d190b admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.282519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 999/1981] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:26 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:26.283344 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d02c2-76be-4160-b9dd-88f917836c41 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.292568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866fc98-24d5-4b9e-aabd-e731a50d190b admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.292825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d02c2-76be-4160-b9dd-88f917836c41 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.297217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e571c5-bf97-4943-b8e2-6f4cb93e8882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.297350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99d147-b025-4b52-8a73-e89a41670825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.297820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e571c5-bf97-4943-b8e2-6f4cb93e8882 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.297934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99d147-b025-4b52-8a73-e89a41670825 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.298100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e571c5-bf97-4943-b8e2-6f4cb93e8882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.298238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99d147-b025-4b52-8a73-e89a41670825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.298399 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e571c5-bf97-4943-b8e2-6f4cb93e8882 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.298495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99d147-b025-4b52-8a73-e89a41670825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.299021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e571c5-bf97-4943-b8e2-6f4cb93e8882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.299121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99d147-b025-4b52-8a73-e89a41670825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.300761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99d147-b025-4b52-8a73-e89a41670825 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.300952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e571c5-bf97-4943-b8e2-6f4cb93e8882 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.312516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1000/1982] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:26.316828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99d147-b025-4b52-8a73-e89a41670825 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.327626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99d147-b025-4b52-8a73-e89a41670825 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.331876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3113a-92aa-4798-8336-fc0815b3977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.332474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3113a-92aa-4798-8336-fc0815b3977e admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.333030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3113a-92aa-4798-8336-fc0815b3977e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.333306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3113a-92aa-4798-8336-fc0815b3977e admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.333945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3113a-92aa-4798-8336-fc0815b3977e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.335687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3113a-92aa-4798-8336-fc0815b3977e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.345387 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1001/1983] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:26.346165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3113a-92aa-4798-8336-fc0815b3977e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.356253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3113a-92aa-4798-8336-fc0815b3977e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.361082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb2d66-624a-4e60-b6d5-5e38203c55b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.361830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb2d66-624a-4e60-b6d5-5e38203c55b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.362047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb2d66-624a-4e60-b6d5-5e38203c55b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.362362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb2d66-624a-4e60-b6d5-5e38203c55b8 admin admin] PATH_INFO: `/v3/projects/3f0d10d8abf6418f9969079b38f99c09/users/76690e57c8af41cd97305c9b25f30961/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.364235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb2d66-624a-4e60-b6d5-5e38203c55b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0d10d8abf6418f9969079b38f99c09, user_id=76690e57c8af41cd97305c9b25f30961, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.368673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb2d66-624a-4e60-b6d5-5e38203c55b8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.378475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1002/1984] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:26 2022] PUT /identity/v3/projects/3f0d10d8abf6418f9969079b38f99c09/users/76690e57c8af41cd97305c9b25f30961/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:26.389298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb2d66-624a-4e60-b6d5-5e38203c55b8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.409748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 983/1985] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:26 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:26.411477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca75b2-b2b0-40c0-8b90-449b5b40f762 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.411971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca75b2-b2b0-40c0-8b90-449b5b40f762 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.412390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca75b2-b2b0-40c0-8b90-449b5b40f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.446819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e0ca75b2-b2b0-40c0-8b90-449b5b40f762 None None] MFA Rules not processed for user `76690e57c8af41cd97305c9b25f30961`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:26.448395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e0ca75b2-b2b0-40c0-8b90-449b5b40f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:26.460725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb2d66-624a-4e60-b6d5-5e38203c55b8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.525038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df4403-caf6-470d-8711-96aa24a587bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.525580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df4403-caf6-470d-8711-96aa24a587bf admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.533937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df4403-caf6-470d-8711-96aa24a587bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.534261 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df4403-caf6-470d-8711-96aa24a587bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.535002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df4403-caf6-470d-8711-96aa24a587bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.536392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 984/1986] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:26.537205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca75b2-b2b0-40c0-8b90-449b5b40f762 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.537396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df4403-caf6-470d-8711-96aa24a587bf admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.549313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca75b2-b2b0-40c0-8b90-449b5b40f762 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.550146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1003/1987] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:26.554389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086c900-6030-4678-8808-a055f1257f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.555083 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086c900-6030-4678-8808-a055f1257f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.555371 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086c900-6030-4678-8808-a055f1257f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.555654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086c900-6030-4678-8808-a055f1257f31 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.556281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086c900-6030-4678-8808-a055f1257f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.558246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086c900-6030-4678-8808-a055f1257f31 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.565763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df4403-caf6-470d-8711-96aa24a587bf admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.576461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df4403-caf6-470d-8711-96aa24a587bf admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.581281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811bec7-e6fc-4204-9f7e-11ae9533e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.590865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811bec7-e6fc-4204-9f7e-11ae9533e474 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.590865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811bec7-e6fc-4204-9f7e-11ae9533e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.590865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811bec7-e6fc-4204-9f7e-11ae9533e474 admin admin] PATH_INFO: `/v3/projects/44177bd2f00749af8316d1d97c3b11b9/users/a40ce55d21c94a2796c4fc5e226cadbf/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.598631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811bec7-e6fc-4204-9f7e-11ae9533e474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44177bd2f00749af8316d1d97c3b11b9, user_id=a40ce55d21c94a2796c4fc5e226cadbf, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.601589 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811bec7-e6fc-4204-9f7e-11ae9533e474 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.642530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 985/1988] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:26 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:26.643594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086c900-6030-4678-8808-a055f1257f31 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.645343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f086c900-6030-4678-8808-a055f1257f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:26.700364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1004/1989] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:26 2022] PUT /identity/v3/projects/44177bd2f00749af8316d1d97c3b11b9/users/a40ce55d21c94a2796c4fc5e226cadbf/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:26.708823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086c900-6030-4678-8808-a055f1257f31 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.711257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811bec7-e6fc-4204-9f7e-11ae9533e474 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.760605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe77e8-c80f-45c1-b4eb-b07dfc80dba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.761409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe77e8-c80f-45c1-b4eb-b07dfc80dba0 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.761690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe77e8-c80f-45c1-b4eb-b07dfc80dba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.761964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe77e8-c80f-45c1-b4eb-b07dfc80dba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.786039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811bec7-e6fc-4204-9f7e-11ae9533e474 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.791475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9613c-f3ca-4ce9-87a7-c0cc28f22784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.792087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9613c-f3ca-4ce9-87a7-c0cc28f22784 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.792536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9613c-f3ca-4ce9-87a7-c0cc28f22784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.792713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9613c-f3ca-4ce9-87a7-c0cc28f22784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.793297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9613c-f3ca-4ce9-87a7-c0cc28f22784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.795014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9613c-f3ca-4ce9-87a7-c0cc28f22784 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.806608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1005/1990] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:26.807881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019119e1-c788-4e1e-8ac0-09dea93326e9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.808201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019119e1-c788-4e1e-8ac0-09dea93326e9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.808482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019119e1-c788-4e1e-8ac0-09dea93326e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.826035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe77e8-c80f-45c1-b4eb-b07dfc80dba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.827555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe77e8-c80f-45c1-b4eb-b07dfc80dba0 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.836936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-019119e1-c788-4e1e-8ac0-09dea93326e9 None None] MFA Rules not processed for user `a40ce55d21c94a2796c4fc5e226cadbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:26.837758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 986/1991] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:26 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:26.838213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-019119e1-c788-4e1e-8ac0-09dea93326e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:26.838610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe77e8-c80f-45c1-b4eb-b07dfc80dba0 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.848980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe77e8-c80f-45c1-b4eb-b07dfc80dba0 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.853789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a76649-466f-4bfe-aa4f-284603123b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.854504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a76649-466f-4bfe-aa4f-284603123b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.854788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a76649-466f-4bfe-aa4f-284603123b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.855060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a76649-466f-4bfe-aa4f-284603123b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.855731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a76649-466f-4bfe-aa4f-284603123b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.857463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a76649-466f-4bfe-aa4f-284603123b28 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.872126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 987/1992] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:26.873498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a76649-466f-4bfe-aa4f-284603123b28 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.889596 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a76649-466f-4bfe-aa4f-284603123b28 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.895323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84c132-a0d5-483e-bacb-b75b11434161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.896788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84c132-a0d5-483e-bacb-b75b11434161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.897346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84c132-a0d5-483e-bacb-b75b11434161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.897785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84c132-a0d5-483e-bacb-b75b11434161 admin admin] PATH_INFO: `/v3/projects/43a14014457542d6886e7736977dacc5/users/5efdc3b249d34716828cf06a5b7b9df8/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.914499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84c132-a0d5-483e-bacb-b75b11434161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a14014457542d6886e7736977dacc5, user_id=5efdc3b249d34716828cf06a5b7b9df8, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.917160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84c132-a0d5-483e-bacb-b75b11434161 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.930991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1006/1993] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:26.935544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019119e1-c788-4e1e-8ac0-09dea93326e9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.949581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019119e1-c788-4e1e-8ac0-09dea93326e9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.953462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f58eb-c3a8-40ab-a37a-56a37ebb3fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.954095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f58eb-c3a8-40ab-a37a-56a37ebb3fdd admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.954415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f58eb-c3a8-40ab-a37a-56a37ebb3fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.954690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f58eb-c3a8-40ab-a37a-56a37ebb3fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.955322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f58eb-c3a8-40ab-a37a-56a37ebb3fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.957210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f58eb-c3a8-40ab-a37a-56a37ebb3fdd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.002482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 988/1994] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:26 2022] PUT /identity/v3/projects/43a14014457542d6886e7736977dacc5/users/5efdc3b249d34716828cf06a5b7b9df8/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:27.003311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84c132-a0d5-483e-bacb-b75b11434161 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.070134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84c132-a0d5-483e-bacb-b75b11434161 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.074973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.075622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.075905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.076180 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] PATH_INFO: `/v3/users/642415aac7c141d9a1ac96bd879f240a` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.077288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=642415aac7c141d9a1ac96bd879f240a)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.079248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.091839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1007/1995] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:26 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:27.093632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25ea83-4cfa-44a5-bea6-1be81477dd78 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.094090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25ea83-4cfa-44a5-bea6-1be81477dd78 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.094537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25ea83-4cfa-44a5-bea6-1be81477dd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.127082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fd25ea83-4cfa-44a5-bea6-1be81477dd78 None None] MFA Rules not processed for user `5efdc3b249d34716828cf06a5b7b9df8`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:27.128297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fd25ea83-4cfa-44a5-bea6-1be81477dd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:27.205473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1008/1996] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:27.206436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25ea83-4cfa-44a5-bea6-1be81477dd78 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.270964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25ea83-4cfa-44a5-bea6-1be81477dd78 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.276045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a72980-31e3-4ae1-a3ba-42f38778f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.276665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a72980-31e3-4ae1-a3ba-42f38778f8fc admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.276946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a72980-31e3-4ae1-a3ba-42f38778f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.277218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a72980-31e3-4ae1-a3ba-42f38778f8fc admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.277839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a72980-31e3-4ae1-a3ba-42f38778f8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.279831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a72980-31e3-4ae1-a3ba-42f38778f8fc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.354370 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642415aac7c141d9a1ac96bd879f240a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.365910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642415aac7c141d9a1ac96bd879f240a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.400916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1009/1997] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:27 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:27.400916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a72980-31e3-4ae1-a3ba-42f38778f8fc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.409727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a72980-31e3-4ae1-a3ba-42f38778f8fc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.417018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9673175-a554-4155-a809-78809bc8461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.417842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9673175-a554-4155-a809-78809bc8461c admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.418129 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9673175-a554-4155-a809-78809bc8461c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.418457 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9673175-a554-4155-a809-78809bc8461c admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.419096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9673175-a554-4155-a809-78809bc8461c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.421106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9673175-a554-4155-a809-78809bc8461c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.436645 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642415aac7c141d9a1ac96bd879f240a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.444439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642415aac7c141d9a1ac96bd879f240a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.445693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642415aac7c141d9a1ac96bd879f240a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.452084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 989/1998] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:27 2022] DELETE /identity/v3/users/642415aac7c141d9a1ac96bd879f240a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:27.453018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.454374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:27.521597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41feae8c-4a5c-4d3e-b98d-556d4d5c26cb admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.527089 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973a26-312e-43cf-b826-0876849cec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.527699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973a26-312e-43cf-b826-0876849cec3e admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.527978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973a26-312e-43cf-b826-0876849cec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.528254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973a26-312e-43cf-b826-0876849cec3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.528902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973a26-312e-43cf-b826-0876849cec3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.530527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973a26-312e-43cf-b826-0876849cec3e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.533659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:27.541215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 990/1999] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:27.542612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a4fd1-e581-49d5-8168-39f0e7638dad None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.542887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a4fd1-e581-49d5-8168-39f0e7638dad None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.543159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a4fd1-e581-49d5-8168-39f0e7638dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.546582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1010/2000] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:27 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:27.547280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9673175-a554-4155-a809-78809bc8461c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.562991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1d4a4fd1-e581-49d5-8168-39f0e7638dad None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:27.564275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1d4a4fd1-e581-49d5-8168-39f0e7638dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:27.615196 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:27.618768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9673175-a554-4155-a809-78809bc8461c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.624152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025d35-a4fa-4fdf-bdcd-4cb00b5d766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.624837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025d35-a4fa-4fdf-bdcd-4cb00b5d766f admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.625128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025d35-a4fa-4fdf-bdcd-4cb00b5d766f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.625413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025d35-a4fa-4fdf-bdcd-4cb00b5d766f admin admin] PATH_INFO: `/v3/projects/4686ebdd5f9d44078daa12229c7a7828/users/e70aaa625f7d49f685aa6d598c237c82/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.637814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 991/2001] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:27.638708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a4fd1-e581-49d5-8168-39f0e7638dad None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.640160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1d4a4fd1-e581-49d5-8168-39f0e7638dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:27.647928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74025d35-a4fa-4fdf-bdcd-4cb00b5d766f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4686ebdd5f9d44078daa12229c7a7828, user_id=e70aaa625f7d49f685aa6d598c237c82, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.651017 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74025d35-a4fa-4fdf-bdcd-4cb00b5d766f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.655675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a4fd1-e581-49d5-8168-39f0e7638dad None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.661134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafab588-dd9c-47b4-86d8-cc327e2ab06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.661789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafab588-dd9c-47b4-86d8-cc327e2ab06d admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.662105 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafab588-dd9c-47b4-86d8-cc327e2ab06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.663003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafab588-dd9c-47b4-86d8-cc327e2ab06d admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.663281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafab588-dd9c-47b4-86d8-cc327e2ab06d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.666282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafab588-dd9c-47b4-86d8-cc327e2ab06d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.834230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 992/2002] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:27 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:27.837592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafab588-dd9c-47b4-86d8-cc327e2ab06d admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.842895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-eafab588-dd9c-47b4-86d8-cc327e2ab06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:27.845787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1011/2003] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:27 2022] PUT /identity/v3/projects/4686ebdd5f9d44078daa12229c7a7828/users/e70aaa625f7d49f685aa6d598c237c82/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:27.846955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025d35-a4fa-4fdf-bdcd-4cb00b5d766f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.906245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafab588-dd9c-47b4-86d8-cc327e2ab06d admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.916277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025d35-a4fa-4fdf-bdcd-4cb00b5d766f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.921312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641880e8-4797-4df0-a207-e50c4f649dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.921938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641880e8-4797-4df0-a207-e50c4f649dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.922373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641880e8-4797-4df0-a207-e50c4f649dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.922833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641880e8-4797-4df0-a207-e50c4f649dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.923620 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641880e8-4797-4df0-a207-e50c4f649dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.925228 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641880e8-4797-4df0-a207-e50c4f649dc5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.936510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1012/2004] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:27.937614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641880e8-4797-4df0-a207-e50c4f649dc5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.949030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641880e8-4797-4df0-a207-e50c4f649dc5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.954156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c51983-22fc-4da0-804c-69e770d3d4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.954917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c51983-22fc-4da0-804c-69e770d3d4be admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.962843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c51983-22fc-4da0-804c-69e770d3d4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.962843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c51983-22fc-4da0-804c-69e770d3d4be admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.962843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c51983-22fc-4da0-804c-69e770d3d4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.962843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c51983-22fc-4da0-804c-69e770d3d4be admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.963492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff3c6-1731-483e-ac63-a0d119238c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.964178 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff3c6-1731-483e-ac63-a0d119238c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.964466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff3c6-1731-483e-ac63-a0d119238c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.964853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff3c6-1731-483e-ac63-a0d119238c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.969890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1013/2005] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:27.971697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c51983-22fc-4da0-804c-69e770d3d4be admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.977313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aff3c6-1731-483e-ac63-a0d119238c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.979774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aff3c6-1731-483e-ac63-a0d119238c6c service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.982608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c51983-22fc-4da0-804c-69e770d3d4be admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.987605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba01c2-8dc1-422e-8f9c-efa5bbb4b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.988384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba01c2-8dc1-422e-8f9c-efa5bbb4b388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.988728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba01c2-8dc1-422e-8f9c-efa5bbb4b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.989113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba01c2-8dc1-422e-8f9c-efa5bbb4b388 admin admin] PATH_INFO: `/v3/projects/8811f27af2a74ddcadd7234d1e6e9a67/users/b6b810f495e74950a7b735f3d29676b0/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.990293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 993/2006] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:27.990913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff3c6-1731-483e-ac63-a0d119238c6c service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.000615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff3c6-1731-483e-ac63-a0d119238c6c service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:28.005773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a828b6-a64e-4953-a69a-a567a70e3ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:28.006569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a828b6-a64e-4953-a69a-a567a70e3ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.006857 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a828b6-a64e-4953-a69a-a567a70e3ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.007817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a828b6-a64e-4953-a69a-a567a70e3ccb admin admin] PATH_INFO: `/v3/projects/4686ebdd5f9d44078daa12229c7a7828/users/e70aaa625f7d49f685aa6d598c237c82/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.010413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a828b6-a64e-4953-a69a-a567a70e3ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4686ebdd5f9d44078daa12229c7a7828, user_id=e70aaa625f7d49f685aa6d598c237c82, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.013251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba01c2-8dc1-422e-8f9c-efa5bbb4b388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8811f27af2a74ddcadd7234d1e6e9a67, user_id=b6b810f495e74950a7b735f3d29676b0, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.013389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a828b6-a64e-4953-a69a-a567a70e3ccb admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.016002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba01c2-8dc1-422e-8f9c-efa5bbb4b388 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.024995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 994/2007] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:27 2022] PUT /identity/v3/projects/4686ebdd5f9d44078daa12229c7a7828/users/e70aaa625f7d49f685aa6d598c237c82/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:28.036244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44272e-556b-4820-95ef-55110827ec21 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.036540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44272e-556b-4820-95ef-55110827ec21 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.036821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44272e-556b-4820-95ef-55110827ec21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.068387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-2e44272e-556b-4820-95ef-55110827ec21 None None] MFA Rules not processed for user `e70aaa625f7d49f685aa6d598c237c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:28.070123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2e44272e-556b-4820-95ef-55110827ec21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:28.084548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1014/2008] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:27 2022] PUT /identity/v3/projects/8811f27af2a74ddcadd7234d1e6e9a67/users/b6b810f495e74950a7b735f3d29676b0/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:28.089250 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba01c2-8dc1-422e-8f9c-efa5bbb4b388 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.160838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 995/2009] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:28.174023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44272e-556b-4820-95ef-55110827ec21 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.180722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2e44272e-556b-4820-95ef-55110827ec21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:28.186540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba01c2-8dc1-422e-8f9c-efa5bbb4b388 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:28.188131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:28.193643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c502e-292c-448a-a9ad-1ff03ffb11f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:28.193643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c502e-292c-448a-a9ad-1ff03ffb11f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.193643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c502e-292c-448a-a9ad-1ff03ffb11f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.193643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c502e-292c-448a-a9ad-1ff03ffb11f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.193951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c502e-292c-448a-a9ad-1ff03ffb11f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.196304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c502e-292c-448a-a9ad-1ff03ffb11f3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.206981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1015/2010] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:28.212473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c502e-292c-448a-a9ad-1ff03ffb11f3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.222786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c502e-292c-448a-a9ad-1ff03ffb11f3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:28.227920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef94da5-3c3d-4e6c-a0c3-77c0237fac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:28.228709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef94da5-3c3d-4e6c-a0c3-77c0237fac27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.229095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef94da5-3c3d-4e6c-a0c3-77c0237fac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.229477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef94da5-3c3d-4e6c-a0c3-77c0237fac27 admin admin] PATH_INFO: `/v3/projects/8811f27af2a74ddcadd7234d1e6e9a67/users/b6b810f495e74950a7b735f3d29676b0/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.231739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef94da5-3c3d-4e6c-a0c3-77c0237fac27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8811f27af2a74ddcadd7234d1e6e9a67, user_id=b6b810f495e74950a7b735f3d29676b0, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.234662 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef94da5-3c3d-4e6c-a0c3-77c0237fac27 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.248124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1016/2011] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:28 2022] PUT /identity/v3/projects/8811f27af2a74ddcadd7234d1e6e9a67/users/b6b810f495e74950a7b735f3d29676b0/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:28.261054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f042dd6-008f-494c-b745-e8e6e4b019b2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.262728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f042dd6-008f-494c-b745-e8e6e4b019b2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.262728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f042dd6-008f-494c-b745-e8e6e4b019b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.268011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44272e-556b-4820-95ef-55110827ec21 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:28.294625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7f042dd6-008f-494c-b745-e8e6e4b019b2 None None] MFA Rules not processed for user `b6b810f495e74950a7b735f3d29676b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:28.296849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7f042dd6-008f-494c-b745-e8e6e4b019b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:28.327263 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b7376-2656-4a3d-8d79-3cd4205d5d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:28.328732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b7376-2656-4a3d-8d79-3cd4205d5d41 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.328732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b7376-2656-4a3d-8d79-3cd4205d5d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.328732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b7376-2656-4a3d-8d79-3cd4205d5d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.389628 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1017/2012] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:28.402876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f042dd6-008f-494c-b745-e8e6e4b019b2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.404441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7f042dd6-008f-494c-b745-e8e6e4b019b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:28.406541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b7376-2656-4a3d-8d79-3cd4205d5d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.407986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b7376-2656-4a3d-8d79-3cd4205d5d41 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.419539 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 996/2013] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:28.419935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f042dd6-008f-494c-b745-e8e6e4b019b2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:28.423805 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54d20-c2ed-4813-b3fc-2798ad36c1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:28.424559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54d20-c2ed-4813-b3fc-2798ad36c1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.424936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54d20-c2ed-4813-b3fc-2798ad36c1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.425278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54d20-c2ed-4813-b3fc-2798ad36c1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.436799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54d20-c2ed-4813-b3fc-2798ad36c1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.438556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54d20-c2ed-4813-b3fc-2798ad36c1b9 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.448849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1018/2014] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:28.476488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b7376-2656-4a3d-8d79-3cd4205d5d41 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.478650 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-da1b7376-2656-4a3d-8d79-3cd4205d5d41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:28.557891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b7376-2656-4a3d-8d79-3cd4205d5d41 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:28.570762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:28.570762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.570762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.570762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] PATH_INFO: `/v3/projects/93e063d809ec49199fd7c373589d5ce2` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.571162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e063d809ec49199fd7c373589d5ce2)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.571162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.605696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54d20-c2ed-4813-b3fc-2798ad36c1b9 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.615931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54d20-c2ed-4813-b3fc-2798ad36c1b9 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:28.620615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a6580-4a3c-4541-967b-5750a083ab6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:28.621268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a6580-4a3c-4541-967b-5750a083ab6a service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.622182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a6580-4a3c-4541-967b-5750a083ab6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.622491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a6580-4a3c-4541-967b-5750a083ab6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.624629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-604a6580-4a3c-4541-967b-5750a083ab6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:28.654310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=82,keystone:INSERT=2,keystone:DELETE=16 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:28.688400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a6580-4a3c-4541-967b-5750a083ab6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.689860 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a6580-4a3c-4541-967b-5750a083ab6a service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.699366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1019/2015] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:28.728785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e063d809ec49199fd7c373589d5ce2', 'request_id': 'req-31c091e1-9755-42ff-a3f8-33ba55d22117'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:28.731155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a6580-4a3c-4541-967b-5750a083ab6a service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.739992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a6580-4a3c-4541-967b-5750a083ab6a service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:28.794325 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbfca8-36c7-46e8-9900-2684fe3f7582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:28.794990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbfca8-36c7-46e8-9900-2684fe3f7582 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.795300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbfca8-36c7-46e8-9900-2684fe3f7582 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.795582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbfca8-36c7-46e8-9900-2684fe3f7582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.797357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c5dbfca8-36c7-46e8-9900-2684fe3f7582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:28.836493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e063d809ec49199fd7c373589d5ce2', 'request_id': 'req-31c091e1-9755-42ff-a3f8-33ba55d22117'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:28.843701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e063d809ec49199fd7c373589d5ce2', 'request_id': 'req-31c091e1-9755-42ff-a3f8-33ba55d22117'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:28.863509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] The token cache is being invalidate because project 93e063d809ec49199fd7c373589d5ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:28.863918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:28.864581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:28.871936 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 997/2016] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:28 2022] DELETE /identity/v3/projects/93e063d809ec49199fd7c373589d5ce2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:28.873894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.876411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:28.914905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbfca8-36c7-46e8-9900-2684fe3f7582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.916783 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbfca8-36c7-46e8-9900-2684fe3f7582 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.933758 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1020/2017] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:28.998868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c091e1-9755-42ff-a3f8-33ba55d22117 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.004421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.005147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.005507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.006086 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] PATH_INFO: `/v3/users/76690e57c8af41cd97305c9b25f30961` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.008402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76690e57c8af41cd97305c9b25f30961)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.011124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.244307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:29.284365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76690e57c8af41cd97305c9b25f30961'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.296277 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76690e57c8af41cd97305c9b25f30961'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.329024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbfca8-36c7-46e8-9900-2684fe3f7582 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.340309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbfca8-36c7-46e8-9900-2684fe3f7582 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.344882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.345518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.345805 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.346089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] PATH_INFO: `/v3/users/a40ce55d21c94a2796c4fc5e226cadbf` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.347258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40ce55d21c94a2796c4fc5e226cadbf)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.349208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.385164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76690e57c8af41cd97305c9b25f30961'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.392717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76690e57c8af41cd97305c9b25f30961'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.393511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b474706d-681a-4a04-9b90-9be4357b3510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76690e57c8af41cd97305c9b25f30961'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.399816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 998/2018] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:28 2022] DELETE /identity/v3/users/76690e57c8af41cd97305c9b25f30961 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:29.559838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40ce55d21c94a2796c4fc5e226cadbf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.560554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40ce55d21c94a2796c4fc5e226cadbf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.567724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40ce55d21c94a2796c4fc5e226cadbf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.579981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40ce55d21c94a2796c4fc5e226cadbf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.665246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40ce55d21c94a2796c4fc5e226cadbf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.671991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1021/2019] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:29 2022] DELETE /identity/v3/users/a40ce55d21c94a2796c4fc5e226cadbf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:29.676542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765188-b833-4cd6-af0f-6d1c788ad2e6 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.677038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765188-b833-4cd6-af0f-6d1c788ad2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.677335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765188-b833-4cd6-af0f-6d1c788ad2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.696827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1d765188-b833-4cd6-af0f-6d1c788ad2e6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:29.698242 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1d765188-b833-4cd6-af0f-6d1c788ad2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:29.759459 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 999/2020] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:29.769392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.770861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:29.832195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67c632-8c86-40f2-89b5-18eeab2dcd71 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.836943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b7b36-9371-4efc-9a41-a5276051fe1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.837563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b7b36-9371-4efc-9a41-a5276051fe1a service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.838902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b7b36-9371-4efc-9a41-a5276051fe1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.838902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b7b36-9371-4efc-9a41-a5276051fe1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.848050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b7b36-9371-4efc-9a41-a5276051fe1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.849647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b7b36-9371-4efc-9a41-a5276051fe1a service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.859952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1022/2021] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:30.281269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d765188-b833-4cd6-af0f-6d1c788ad2e6 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.284194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1d765188-b833-4cd6-af0f-6d1c788ad2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:30.296655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d765188-b833-4cd6-af0f-6d1c788ad2e6 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.302775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.304769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.304769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.304769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] PATH_INFO: `/v3/projects/3f0d10d8abf6418f9969079b38f99c09` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.305622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0d10d8abf6418f9969079b38f99c09)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.307716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.439102 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0d10d8abf6418f9969079b38f99c09', 'request_id': 'req-2a1f590d-7fee-440e-8e62-9da1522a3aa1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.525212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b7b36-9371-4efc-9a41-a5276051fe1a service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.526752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-da4b7b36-9371-4efc-9a41-a5276051fe1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:30.540275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0d10d8abf6418f9969079b38f99c09', 'request_id': 'req-2a1f590d-7fee-440e-8e62-9da1522a3aa1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.542421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:30.545536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b7b36-9371-4efc-9a41-a5276051fe1a service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.546658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0d10d8abf6418f9969079b38f99c09', 'request_id': 'req-2a1f590d-7fee-440e-8e62-9da1522a3aa1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.560511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] The token cache is being invalidate because project 3f0d10d8abf6418f9969079b38f99c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:30.560812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.561976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2a1f590d-7fee-440e-8e62-9da1522a3aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.563515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1000/2022] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:30 2022] DELETE /identity/v3/projects/3f0d10d8abf6418f9969079b38f99c09 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:30.568384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44f999-4b4a-4f05-b308-5f395b9788cb None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.568678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44f999-4b4a-4f05-b308-5f395b9788cb None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.568960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44f999-4b4a-4f05-b308-5f395b9788cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.589796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-8a44f999-4b4a-4f05-b308-5f395b9788cb None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:30.591364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8a44f999-4b4a-4f05-b308-5f395b9788cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:30.609256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.609907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.610813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.611123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] PATH_INFO: `/v3/projects/44177bd2f00749af8316d1d97c3b11b9` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.612307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] RBAC: Authorizing `identity:delete_project(project_id=44177bd2f00749af8316d1d97c3b11b9)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.614347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.625695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:30.656088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1001/2023] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:30.663630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421bf8d-f78d-4feb-98b4-167c524098a2 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.664830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421bf8d-f78d-4feb-98b4-167c524098a2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.664830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421bf8d-f78d-4feb-98b4-167c524098a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.684065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6421bf8d-f78d-4feb-98b4-167c524098a2 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:30.685943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6421bf8d-f78d-4feb-98b4-167c524098a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:30.693636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1002/2024] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:30.698346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421bf8d-f78d-4feb-98b4-167c524098a2 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.707257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421bf8d-f78d-4feb-98b4-167c524098a2 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.712173 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9993b1e-d464-4880-b491-1107d7ad83bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.716160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9993b1e-d464-4880-b491-1107d7ad83bf admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.716160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9993b1e-d464-4880-b491-1107d7ad83bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.716160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9993b1e-d464-4880-b491-1107d7ad83bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.716160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9993b1e-d464-4880-b491-1107d7ad83bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:30.716160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9993b1e-d464-4880-b491-1107d7ad83bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.716160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9993b1e-d464-4880-b491-1107d7ad83bf admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.727438 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1003/2025] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:48:30.731543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9993b1e-d464-4880-b491-1107d7ad83bf admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.741319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9993b1e-d464-4880-b491-1107d7ad83bf admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.746960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde06c-8684-41eb-bbb7-2b005d7e1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.754778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde06c-8684-41eb-bbb7-2b005d7e1f81 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.754778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde06c-8684-41eb-bbb7-2b005d7e1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.754778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde06c-8684-41eb-bbb7-2b005d7e1f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.754778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dde06c-8684-41eb-bbb7-2b005d7e1f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.754778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dde06c-8684-41eb-bbb7-2b005d7e1f81 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.758310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44177bd2f00749af8316d1d97c3b11b9', 'request_id': 'req-b25224b5-4089-4367-a686-bfb4a08be26f'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.764783 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44177bd2f00749af8316d1d97c3b11b9', 'request_id': 'req-b25224b5-4089-4367-a686-bfb4a08be26f'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.927979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44177bd2f00749af8316d1d97c3b11b9', 'request_id': 'req-b25224b5-4089-4367-a686-bfb4a08be26f'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.936063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1004/2026] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:30 2022] POST /identity/v3/projects => generated 355 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:30.942587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde06c-8684-41eb-bbb7-2b005d7e1f81 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.944082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] The token cache is being invalidate because project 44177bd2f00749af8316d1d97c3b11b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:30.944415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.945142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.946747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1023/2027] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:30 2022] DELETE /identity/v3/projects/44177bd2f00749af8316d1d97c3b11b9 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:30.950687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.952644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:31.018216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde06c-8684-41eb-bbb7-2b005d7e1f81 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.023947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333435bb-9538-4ab9-84dd-2d11fd046c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.024576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333435bb-9538-4ab9-84dd-2d11fd046c8d admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.024956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333435bb-9538-4ab9-84dd-2d11fd046c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.025239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333435bb-9538-4ab9-84dd-2d11fd046c8d admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.026150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333435bb-9538-4ab9-84dd-2d11fd046c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.027059 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25224b5-4089-4367-a686-bfb4a08be26f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.027841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333435bb-9538-4ab9-84dd-2d11fd046c8d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.031876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.032527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.032817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.033097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] PATH_INFO: `/v3/users/e70aaa625f7d49f685aa6d598c237c82` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.034272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70aaa625f7d49f685aa6d598c237c82)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.036297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.108449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1005/2028] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:30 2022] POST /identity/v3/users => generated 278 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:31.112425 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333435bb-9538-4ab9-84dd-2d11fd046c8d admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.114333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-333435bb-9538-4ab9-84dd-2d11fd046c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:31.127979 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333435bb-9538-4ab9-84dd-2d11fd046c8d admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.132698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b7bc5-b7b1-434f-9c73-bfeb50fe33af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.133290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7bc5-b7b1-434f-9c73-bfeb50fe33af admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.133574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7bc5-b7b1-434f-9c73-bfeb50fe33af admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.133853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7bc5-b7b1-434f-9c73-bfeb50fe33af admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.134526 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b7bc5-b7b1-434f-9c73-bfeb50fe33af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.136116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b7bc5-b7b1-434f-9c73-bfeb50fe33af admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.146098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1006/2029] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:31.154136 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b7bc5-b7b1-434f-9c73-bfeb50fe33af admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.164209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b7bc5-b7b1-434f-9c73-bfeb50fe33af admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.172717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8d24-c41e-4f05-9681-6fe2bd4d5836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.172717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8d24-c41e-4f05-9681-6fe2bd4d5836 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.172717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8d24-c41e-4f05-9681-6fe2bd4d5836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.172717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8d24-c41e-4f05-9681-6fe2bd4d5836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.175565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8d24-c41e-4f05-9681-6fe2bd4d5836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.175565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8d24-c41e-4f05-9681-6fe2bd4d5836 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.188452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1007/2030] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:31.189482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8d24-c41e-4f05-9681-6fe2bd4d5836 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.199158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8d24-c41e-4f05-9681-6fe2bd4d5836 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.204151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351ebe7-2b9b-4a11-9d98-03eac743d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.204374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351ebe7-2b9b-4a11-9d98-03eac743d370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.204643 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351ebe7-2b9b-4a11-9d98-03eac743d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.204916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351ebe7-2b9b-4a11-9d98-03eac743d370 admin admin] PATH_INFO: `/v3/projects/15ec2e4f9a3248f2b5132aea33e97139/users/2f3f82f9da1941198f81f72052c27b80/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.219571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351ebe7-2b9b-4a11-9d98-03eac743d370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ec2e4f9a3248f2b5132aea33e97139, user_id=2f3f82f9da1941198f81f72052c27b80, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.222441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351ebe7-2b9b-4a11-9d98-03eac743d370 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.233000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70aaa625f7d49f685aa6d598c237c82'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:31.233680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70aaa625f7d49f685aa6d598c237c82'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:31.240822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70aaa625f7d49f685aa6d598c237c82'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:31.253440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70aaa625f7d49f685aa6d598c237c82'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:31.316181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e2fc89ed-e43a-4d39-882b-1fb373a59a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70aaa625f7d49f685aa6d598c237c82'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:31.322839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1024/2031] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:30 2022] DELETE /identity/v3/users/e70aaa625f7d49f685aa6d598c237c82 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:31.323351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1008/2032] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:31 2022] PUT /identity/v3/projects/15ec2e4f9a3248f2b5132aea33e97139/users/2f3f82f9da1941198f81f72052c27b80/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:31.333630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905a35-9f3f-484b-bb66-5c388e20fe4c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.333917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905a35-9f3f-484b-bb66-5c388e20fe4c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.334216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905a35-9f3f-484b-bb66-5c388e20fe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.363868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e5905a35-9f3f-484b-bb66-5c388e20fe4c None None] MFA Rules not processed for user `2f3f82f9da1941198f81f72052c27b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:31.364989 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e5905a35-9f3f-484b-bb66-5c388e20fe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:31.454633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1025/2033] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:31.461281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351ebe7-2b9b-4a11-9d98-03eac743d370 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.463093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9351ebe7-2b9b-4a11-9d98-03eac743d370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:31.558452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351ebe7-2b9b-4a11-9d98-03eac743d370 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.637199 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dfb4c-bd0d-49a4-bfd4-5a3edf7ecfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.637830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dfb4c-bd0d-49a4-bfd4-5a3edf7ecfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.638311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dfb4c-bd0d-49a4-bfd4-5a3edf7ecfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.638597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dfb4c-bd0d-49a4-bfd4-5a3edf7ecfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.639347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dfb4c-bd0d-49a4-bfd4-5a3edf7ecfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.645639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dfb4c-bd0d-49a4-bfd4-5a3edf7ecfe0 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.809063 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1009/2034] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:31 2022] POST /identity/v3/projects => generated 357 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:31.813200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5905a35-9f3f-484b-bb66-5c388e20fe4c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.824805 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5905a35-9f3f-484b-bb66-5c388e20fe4c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.855436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dfb4c-bd0d-49a4-bfd4-5a3edf7ecfe0 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.857187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c11dfb4c-bd0d-49a4-bfd4-5a3edf7ecfe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:31.886035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985addb-6066-49fb-8567-ae488c2d762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.886693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985addb-6066-49fb-8567-ae488c2d762b admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.886980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985addb-6066-49fb-8567-ae488c2d762b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.887263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985addb-6066-49fb-8567-ae488c2d762b admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.887910 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985addb-6066-49fb-8567-ae488c2d762b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.890035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985addb-6066-49fb-8567-ae488c2d762b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.925958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dfb4c-bd0d-49a4-bfd4-5a3edf7ecfe0 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.931472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.932216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.932423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.932702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] PATH_INFO: `/v3/projects/4686ebdd5f9d44078daa12229c7a7828` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.933939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4686ebdd5f9d44078daa12229c7a7828)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.935786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.990970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1026/2035] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:31 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:31.995104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985addb-6066-49fb-8567-ae488c2d762b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.004648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985addb-6066-49fb-8567-ae488c2d762b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.010018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f2e41-c580-4de3-b0f8-f1695c58f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.010634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f2e41-c580-4de3-b0f8-f1695c58f579 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.010922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f2e41-c580-4de3-b0f8-f1695c58f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.011201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f2e41-c580-4de3-b0f8-f1695c58f579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.011899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f2e41-c580-4de3-b0f8-f1695c58f579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.013600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f2e41-c580-4de3-b0f8-f1695c58f579 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.024615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1027/2036] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:32.028763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f2e41-c580-4de3-b0f8-f1695c58f579 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.038334 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f2e41-c580-4de3-b0f8-f1695c58f579 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.043466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e05af3-9d95-4e91-84df-9c48fa8bd898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.044099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e05af3-9d95-4e91-84df-9c48fa8bd898 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.045872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e05af3-9d95-4e91-84df-9c48fa8bd898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.045872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e05af3-9d95-4e91-84df-9c48fa8bd898 admin admin] PATH_INFO: `/v3/projects/2c62b757d9bc447a896e6b42ab44422d/users/8c070f2fee4e49cf9ba9356f60b7a8f9/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.059703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e05af3-9d95-4e91-84df-9c48fa8bd898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c62b757d9bc447a896e6b42ab44422d, user_id=8c070f2fee4e49cf9ba9356f60b7a8f9, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.060071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4686ebdd5f9d44078daa12229c7a7828', 'request_id': 'req-48b1d770-5960-4181-9ca7-762f66e1f1c2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:32.062390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e05af3-9d95-4e91-84df-9c48fa8bd898 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.167328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4686ebdd5f9d44078daa12229c7a7828', 'request_id': 'req-48b1d770-5960-4181-9ca7-762f66e1f1c2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:32.173535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1028/2037] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:32 2022] PUT /identity/v3/projects/2c62b757d9bc447a896e6b42ab44422d/users/8c070f2fee4e49cf9ba9356f60b7a8f9/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:32.173684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4686ebdd5f9d44078daa12229c7a7828', 'request_id': 'req-48b1d770-5960-4181-9ca7-762f66e1f1c2'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:32.177855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e05af3-9d95-4e91-84df-9c48fa8bd898 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.186446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] The token cache is being invalidate because project 4686ebdd5f9d44078daa12229c7a7828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:32.186738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:32.187401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-48b1d770-5960-4181-9ca7-762f66e1f1c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:32.188992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1010/2038] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:31 2022] DELETE /identity/v3/projects/4686ebdd5f9d44078daa12229c7a7828 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:32.193503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b817c-3ff4-48af-ad4d-c93449bb8527 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.193784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b817c-3ff4-48af-ad4d-c93449bb8527 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.194060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b817c-3ff4-48af-ad4d-c93449bb8527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.214771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-8b2b817c-3ff4-48af-ad4d-c93449bb8527 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:32.216108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8b2b817c-3ff4-48af-ad4d-c93449bb8527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:32.238769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:32.243321 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e05af3-9d95-4e91-84df-9c48fa8bd898 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.248880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d41ea-da33-4b83-9139-9f79271e73fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.249497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d41ea-da33-4b83-9139-9f79271e73fc admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.249812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d41ea-da33-4b83-9139-9f79271e73fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.250092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d41ea-da33-4b83-9139-9f79271e73fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.250804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d41ea-da33-4b83-9139-9f79271e73fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.252554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d41ea-da33-4b83-9139-9f79271e73fc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.263335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1029/2039] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:32.267531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d41ea-da33-4b83-9139-9f79271e73fc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.269303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6a6d41ea-da33-4b83-9139-9f79271e73fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:32.278756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1011/2040] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:32.282102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d41ea-da33-4b83-9139-9f79271e73fc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.286682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137a5a7-6430-43ed-a771-1ef59216cd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.287333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137a5a7-6430-43ed-a771-1ef59216cd35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.287620 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137a5a7-6430-43ed-a771-1ef59216cd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.287901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137a5a7-6430-43ed-a771-1ef59216cd35 admin admin] PATH_INFO: `/v3/projects/2c62b757d9bc447a896e6b42ab44422d/users/8c070f2fee4e49cf9ba9356f60b7a8f9/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.289971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137a5a7-6430-43ed-a771-1ef59216cd35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c62b757d9bc447a896e6b42ab44422d, user_id=8c070f2fee4e49cf9ba9356f60b7a8f9, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.292792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137a5a7-6430-43ed-a771-1ef59216cd35 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.293065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9f7d-e334-4a14-b6e5-167a33f78651 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.293359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9f7d-e334-4a14-b6e5-167a33f78651 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.293641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9f7d-e334-4a14-b6e5-167a33f78651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.303142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1030/2041] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:32 2022] PUT /identity/v3/projects/2c62b757d9bc447a896e6b42ab44422d/users/8c070f2fee4e49cf9ba9356f60b7a8f9/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:32.311511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:32.313632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-aa9f9f7d-e334-4a14-b6e5-167a33f78651 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:32.321059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-aa9f9f7d-e334-4a14-b6e5-167a33f78651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:32.321180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68890-a988-4f3e-a9a9-bd7b625c8ef2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.321180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68890-a988-4f3e-a9a9-bd7b625c8ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.321180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68890-a988-4f3e-a9a9-bd7b625c8ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.344495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-aff68890-a988-4f3e-a9a9-bd7b625c8ef2 None None] MFA Rules not processed for user `8c070f2fee4e49cf9ba9356f60b7a8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:32.345709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aff68890-a988-4f3e-a9a9-bd7b625c8ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:32.375431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1012/2042] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:32.379611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f9f7d-e334-4a14-b6e5-167a33f78651 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.389777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f9f7d-e334-4a14-b6e5-167a33f78651 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.394531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351c6a3-3196-4846-8fa4-579b0a545bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.395460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c6a3-3196-4846-8fa4-579b0a545bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.395460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c6a3-3196-4846-8fa4-579b0a545bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.395689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c6a3-3196-4846-8fa4-579b0a545bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.396339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351c6a3-3196-4846-8fa4-579b0a545bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:32.396650 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351c6a3-3196-4846-8fa4-579b0a545bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.398519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351c6a3-3196-4846-8fa4-579b0a545bd4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.410131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1013/2043] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:32.415000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1031/2044] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:32.415125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351c6a3-3196-4846-8fa4-579b0a545bd4 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.425219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351c6a3-3196-4846-8fa4-579b0a545bd4 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.427229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff68890-a988-4f3e-a9a9-bd7b625c8ef2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.428597 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aff68890-a988-4f3e-a9a9-bd7b625c8ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:32.430812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515c069-7ec4-49c5-a7e6-470e5e81ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.431412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c069-7ec4-49c5-a7e6-470e5e81ab7f admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.439358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c069-7ec4-49c5-a7e6-470e5e81ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.439358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c069-7ec4-49c5-a7e6-470e5e81ab7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.439358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515c069-7ec4-49c5-a7e6-470e5e81ab7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.439358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515c069-7ec4-49c5-a7e6-470e5e81ab7f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.485930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff68890-a988-4f3e-a9a9-bd7b625c8ef2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.489581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b11a-1a1a-44c8-b409-c9358f8d31eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.490210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b11a-1a1a-44c8-b409-c9358f8d31eb service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.490511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b11a-1a1a-44c8-b409-c9358f8d31eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.490788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b11a-1a1a-44c8-b409-c9358f8d31eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.507926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8b11a-1a1a-44c8-b409-c9358f8d31eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.509366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8b11a-1a1a-44c8-b409-c9358f8d31eb service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.518826 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1032/2045] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:32.531589 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1014/2046] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:32 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:32.536413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b11a-1a1a-44c8-b409-c9358f8d31eb service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.548267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b11a-1a1a-44c8-b409-c9358f8d31eb service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.609120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2339d-422f-4cb5-bf95-929acd4f69ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.609735 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2339d-422f-4cb5-bf95-929acd4f69ca admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.610026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2339d-422f-4cb5-bf95-929acd4f69ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.610339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2339d-422f-4cb5-bf95-929acd4f69ca admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.610967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2339d-422f-4cb5-bf95-929acd4f69ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.613116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2339d-422f-4cb5-bf95-929acd4f69ca admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.734683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1033/2047] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:32 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:32.738890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515c069-7ec4-49c5-a7e6-470e5e81ab7f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.750077 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515c069-7ec4-49c5-a7e6-470e5e81ab7f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.755747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c27175-e28e-4ab6-b908-5a6657e44e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.756460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c27175-e28e-4ab6-b908-5a6657e44e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.756833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c27175-e28e-4ab6-b908-5a6657e44e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.757811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c27175-e28e-4ab6-b908-5a6657e44e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.758795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c27175-e28e-4ab6-b908-5a6657e44e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.760300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c27175-e28e-4ab6-b908-5a6657e44e4f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.778578 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1015/2048] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:32.779695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2339d-422f-4cb5-bf95-929acd4f69ca admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.789457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c27175-e28e-4ab6-b908-5a6657e44e4f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.792482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2339d-422f-4cb5-bf95-929acd4f69ca admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.802927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa6d6a-6dd5-4678-9cc7-153ef22d51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.804657 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa6d6a-6dd5-4678-9cc7-153ef22d51df admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.805312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa6d6a-6dd5-4678-9cc7-153ef22d51df admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.805704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa6d6a-6dd5-4678-9cc7-153ef22d51df admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.806844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa6d6a-6dd5-4678-9cc7-153ef22d51df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.809122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa6d6a-6dd5-4678-9cc7-153ef22d51df admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.840719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1034/2049] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:32.841769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa6d6a-6dd5-4678-9cc7-153ef22d51df admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.854523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa6d6a-6dd5-4678-9cc7-153ef22d51df admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.860708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8a530-4ca4-4f39-b0f0-5a212349bd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.861438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a530-4ca4-4f39-b0f0-5a212349bd40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.861684 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a530-4ca4-4f39-b0f0-5a212349bd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.861964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a530-4ca4-4f39-b0f0-5a212349bd40 admin admin] PATH_INFO: `/v3/projects/b7922afc8be042fcadd3185770a8275a/users/51c39e88b1fc4b0fa4d99be23e3a3d3b/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.870001 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c27175-e28e-4ab6-b908-5a6657e44e4f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.875630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a79953-af1a-41fb-99bc-ce27b26e117d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.876894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a79953-af1a-41fb-99bc-ce27b26e117d service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.877451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a79953-af1a-41fb-99bc-ce27b26e117d service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.877968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a79953-af1a-41fb-99bc-ce27b26e117d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.881095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8a530-4ca4-4f39-b0f0-5a212349bd40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7922afc8be042fcadd3185770a8275a, user_id=51c39e88b1fc4b0fa4d99be23e3a3d3b, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.881229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-60a79953-af1a-41fb-99bc-ce27b26e117d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:32.882789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8a530-4ca4-4f39-b0f0-5a212349bd40 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.948176 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a79953-af1a-41fb-99bc-ce27b26e117d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.949654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a79953-af1a-41fb-99bc-ce27b26e117d service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.959015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1016/2050] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:32.981625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1035/2051] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:32 2022] PUT /identity/v3/projects/b7922afc8be042fcadd3185770a8275a/users/51c39e88b1fc4b0fa4d99be23e3a3d3b/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:32.994229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20173f0c-982c-42e4-b3e5-f11ff5acab3a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.994722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20173f0c-982c-42e4-b3e5-f11ff5acab3a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.995003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20173f0c-982c-42e4-b3e5-f11ff5acab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.023014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-20173f0c-982c-42e4-b3e5-f11ff5acab3a None None] MFA Rules not processed for user `51c39e88b1fc4b0fa4d99be23e3a3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:33.024269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-20173f0c-982c-42e4-b3e5-f11ff5acab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:33.087651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1017/2052] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:33.092126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8a530-4ca4-4f39-b0f0-5a212349bd40 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:33.156969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:33.171183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8a530-4ca4-4f39-b0f0-5a212349bd40 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:33.176059 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24367d-2726-4198-a977-faf581f66a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:33.176965 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24367d-2726-4198-a977-faf581f66a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.177242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24367d-2726-4198-a977-faf581f66a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.177514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24367d-2726-4198-a977-faf581f66a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.178214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24367d-2726-4198-a977-faf581f66a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:33.181390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24367d-2726-4198-a977-faf581f66a38 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:33.291742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1036/2053] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:33 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:33.295601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20173f0c-982c-42e4-b3e5-f11ff5acab3a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:33.307356 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20173f0c-982c-42e4-b3e5-f11ff5acab3a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:33.362810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d732f-9bd6-4068-940d-8cb168216c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:33.363422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d732f-9bd6-4068-940d-8cb168216c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.363708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d732f-9bd6-4068-940d-8cb168216c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.363981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d732f-9bd6-4068-940d-8cb168216c25 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.364613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d732f-9bd6-4068-940d-8cb168216c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:33.367196 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d732f-9bd6-4068-940d-8cb168216c25 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:33.464030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1018/2054] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:33 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:33.465135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24367d-2726-4198-a977-faf581f66a38 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:33.475569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24367d-2726-4198-a977-faf581f66a38 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:33.480583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5c040-1fed-46a3-b041-13e951d8be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:33.481222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c040-1fed-46a3-b041-13e951d8be31 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.481503 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c040-1fed-46a3-b041-13e951d8be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.481773 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c040-1fed-46a3-b041-13e951d8be31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.482449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5c040-1fed-46a3-b041-13e951d8be31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:33.484018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5c040-1fed-46a3-b041-13e951d8be31 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:33.499651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1037/2055] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:33.504031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d732f-9bd6-4068-940d-8cb168216c25 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:33.515044 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d732f-9bd6-4068-940d-8cb168216c25 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:33.519605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506a0d-9f7d-47a8-bba9-1d3002b11fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:33.520259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506a0d-9f7d-47a8-bba9-1d3002b11fec admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.520544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506a0d-9f7d-47a8-bba9-1d3002b11fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.520824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506a0d-9f7d-47a8-bba9-1d3002b11fec admin admin] PATH_INFO: `/v3/projects/d790f94fb2954320a6b901d7a32c6766/users/a037a39c64d74103b3819f494453e7cc/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.536066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9506a0d-9f7d-47a8-bba9-1d3002b11fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d790f94fb2954320a6b901d7a32c6766, user_id=a037a39c64d74103b3819f494453e7cc, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:33.539272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9506a0d-9f7d-47a8-bba9-1d3002b11fec admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:33.688700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1019/2056] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:33 2022] PUT /identity/v3/projects/d790f94fb2954320a6b901d7a32c6766/users/a037a39c64d74103b3819f494453e7cc/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:33.692777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5c040-1fed-46a3-b041-13e951d8be31 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:33.703373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5c040-1fed-46a3-b041-13e951d8be31 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:33.763610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bc20c-5320-46ed-98b2-e68998e078e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:33.764251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bc20c-5320-46ed-98b2-e68998e078e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.764536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bc20c-5320-46ed-98b2-e68998e078e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.764815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bc20c-5320-46ed-98b2-e68998e078e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.765457 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bc20c-5320-46ed-98b2-e68998e078e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:33.767099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bc20c-5320-46ed-98b2-e68998e078e0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:33.776889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1038/2057] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:33.781186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506a0d-9f7d-47a8-bba9-1d3002b11fec admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:33.791934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506a0d-9f7d-47a8-bba9-1d3002b11fec admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:33.796882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0feabe-1c57-4a9c-bb44-0eac1c2cd534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:33.797534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0feabe-1c57-4a9c-bb44-0eac1c2cd534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.797824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0feabe-1c57-4a9c-bb44-0eac1c2cd534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.798099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0feabe-1c57-4a9c-bb44-0eac1c2cd534 admin admin] PATH_INFO: `/v3/projects/d790f94fb2954320a6b901d7a32c6766/users/a037a39c64d74103b3819f494453e7cc/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.800206 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0feabe-1c57-4a9c-bb44-0eac1c2cd534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d790f94fb2954320a6b901d7a32c6766, user_id=a037a39c64d74103b3819f494453e7cc, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:33.807039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0feabe-1c57-4a9c-bb44-0eac1c2cd534 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:33.818270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1020/2058] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:33 2022] PUT /identity/v3/projects/d790f94fb2954320a6b901d7a32c6766/users/a037a39c64d74103b3819f494453e7cc/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:33.830319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027fc1-aa76-409e-93aa-627040771bce None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.830637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027fc1-aa76-409e-93aa-627040771bce None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.830912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027fc1-aa76-409e-93aa-627040771bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.861538 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ab027fc1-aa76-409e-93aa-627040771bce None None] MFA Rules not processed for user `a037a39c64d74103b3819f494453e7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:33.862777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ab027fc1-aa76-409e-93aa-627040771bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:33.878357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:33.939363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1039/2059] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:33.951010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0feabe-1c57-4a9c-bb44-0eac1c2cd534 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:34.016688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0feabe-1c57-4a9c-bb44-0eac1c2cd534 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:34.020723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231a9e1-b6db-4ed2-b6a2-3726f826d556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:34.021338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231a9e1-b6db-4ed2-b6a2-3726f826d556 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.021622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231a9e1-b6db-4ed2-b6a2-3726f826d556 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.021928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231a9e1-b6db-4ed2-b6a2-3726f826d556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.085004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231a9e1-b6db-4ed2-b6a2-3726f826d556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:34.086879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231a9e1-b6db-4ed2-b6a2-3726f826d556 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:34.096100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1021/2060] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:35.453933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:36.057998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027fc1-aa76-409e-93aa-627040771bce None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:36.062047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ab027fc1-aa76-409e-93aa-627040771bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:36.124021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027fc1-aa76-409e-93aa-627040771bce None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:36.128748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:36.129375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.129658 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.129958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] PATH_INFO: `/v3/users/5efdc3b249d34716828cf06a5b7b9df8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.131097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5efdc3b249d34716828cf06a5b7b9df8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:36.133013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:36.347647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5efdc3b249d34716828cf06a5b7b9df8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:36.348384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5efdc3b249d34716828cf06a5b7b9df8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:36.355925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5efdc3b249d34716828cf06a5b7b9df8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:36.368706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5efdc3b249d34716828cf06a5b7b9df8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:36.442638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5efdc3b249d34716828cf06a5b7b9df8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:36.455336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1040/2061] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:36 2022] DELETE /identity/v3/users/5efdc3b249d34716828cf06a5b7b9df8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:36.455961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5422cd-f556-4b96-82ee-f81be2c3d74d None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.455961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5422cd-f556-4b96-82ee-f81be2c3d74d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.455961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5422cd-f556-4b96-82ee-f81be2c3d74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.474450 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-2c5422cd-f556-4b96-82ee-f81be2c3d74d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:36.475726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2c5422cd-f556-4b96-82ee-f81be2c3d74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:36.541010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1022/2062] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:36.551916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:36.553664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:36.615645 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb566bda-35d9-4fed-a02b-f75f12c21058 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:36.625634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a51396-ac33-4feb-a1c8-45ce07e69aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:36.625634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a51396-ac33-4feb-a1c8-45ce07e69aee service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.625634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a51396-ac33-4feb-a1c8-45ce07e69aee service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.625634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a51396-ac33-4feb-a1c8-45ce07e69aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.637482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a51396-ac33-4feb-a1c8-45ce07e69aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:36.639229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a51396-ac33-4feb-a1c8-45ce07e69aee service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:36.649210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:36.650668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1041/2063] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:37.167251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5422cd-f556-4b96-82ee-f81be2c3d74d None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:37.169066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2c5422cd-f556-4b96-82ee-f81be2c3d74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:37.201185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5422cd-f556-4b96-82ee-f81be2c3d74d None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:37.209811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:37.210574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:37.210852 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:37.211150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] PATH_INFO: `/v3/projects/43a14014457542d6886e7736977dacc5` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:37.212737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a14014457542d6886e7736977dacc5)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:37.215986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:37.374216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a14014457542d6886e7736977dacc5', 'request_id': 'req-27c51b74-565f-4260-a488-575d82756fe1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:37.470392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a14014457542d6886e7736977dacc5', 'request_id': 'req-27c51b74-565f-4260-a488-575d82756fe1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:37.476450 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a14014457542d6886e7736977dacc5', 'request_id': 'req-27c51b74-565f-4260-a488-575d82756fe1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:37.489224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] The token cache is being invalidate because project 43a14014457542d6886e7736977dacc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:37.489511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:37.490155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:37.491691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1023/2064] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:37 2022] DELETE /identity/v3/projects/43a14014457542d6886e7736977dacc5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:37.495911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a51396-ac33-4feb-a1c8-45ce07e69aee service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:37.505627 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a51396-ac33-4feb-a1c8-45ce07e69aee service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:37.560667 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:37.561303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:37.561587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:37.561867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] PATH_INFO: `/v3/users/b6b810f495e74950a7b735f3d29676b0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:37.563018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b810f495e74950a7b735f3d29676b0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:37.565018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:37.862326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b810f495e74950a7b735f3d29676b0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:37.863317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b810f495e74950a7b735f3d29676b0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:37.870546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b810f495e74950a7b735f3d29676b0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:37.882963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b810f495e74950a7b735f3d29676b0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:37.967901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-024dfb4b-35ab-4288-98ab-5eb0856d3b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b810f495e74950a7b735f3d29676b0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:37.974234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1042/2065] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:37 2022] DELETE /identity/v3/users/b6b810f495e74950a7b735f3d29676b0 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:38.420073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:38.421801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:38.435663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c51b74-565f-4260-a488-575d82756fe1 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:38.493307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:38.493994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:38.494236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:38.494519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] PATH_INFO: `/v3/projects/8811f27af2a74ddcadd7234d1e6e9a67` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:38.495654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8811f27af2a74ddcadd7234d1e6e9a67)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:38.497553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:38.608292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8811f27af2a74ddcadd7234d1e6e9a67', 'request_id': 'req-642ab829-8c2c-4b3c-af6b-e1e27777369e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:38.716685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8811f27af2a74ddcadd7234d1e6e9a67', 'request_id': 'req-642ab829-8c2c-4b3c-af6b-e1e27777369e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:38.723015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8811f27af2a74ddcadd7234d1e6e9a67', 'request_id': 'req-642ab829-8c2c-4b3c-af6b-e1e27777369e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:38.734617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] The token cache is being invalidate because project 8811f27af2a74ddcadd7234d1e6e9a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:38.734907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:38.735538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-642ab829-8c2c-4b3c-af6b-e1e27777369e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:38.737020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1024/2066] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:38 2022] DELETE /identity/v3/projects/8811f27af2a74ddcadd7234d1e6e9a67 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:38.741850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0c88-1e44-4cf9-b83f-233be0d08892 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:38.742324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0c88-1e44-4cf9-b83f-233be0d08892 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:38.742432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0c88-1e44-4cf9-b83f-233be0d08892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:38.763233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-de3e0c88-1e44-4cf9-b83f-233be0d08892 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:38.764436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-de3e0c88-1e44-4cf9-b83f-233be0d08892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:38.824149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1043/2067] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:38.832421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bc692-edce-4ed4-85b9-5a94568db9fe None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:38.832703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bc692-edce-4ed4-85b9-5a94568db9fe None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:38.832977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bc692-edce-4ed4-85b9-5a94568db9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:38.853408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e27bc692-edce-4ed4-85b9-5a94568db9fe None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:38.856879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e27bc692-edce-4ed4-85b9-5a94568db9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:38.862891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1025/2068] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:38.866968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e0c88-1e44-4cf9-b83f-233be0d08892 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:38.877270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e0c88-1e44-4cf9-b83f-233be0d08892 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:38.881821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58760a0f-3fe4-4524-8555-8544325a2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:38.887883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58760a0f-3fe4-4524-8555-8544325a2a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:38.887883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58760a0f-3fe4-4524-8555-8544325a2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:38.887883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58760a0f-3fe4-4524-8555-8544325a2a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:38.887883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58760a0f-3fe4-4524-8555-8544325a2a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:38.887883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58760a0f-3fe4-4524-8555-8544325a2a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:38.887883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58760a0f-3fe4-4524-8555-8544325a2a4d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:38.897409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1044/2069] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:38.901777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bc692-edce-4ed4-85b9-5a94568db9fe None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:38.910786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bc692-edce-4ed4-85b9-5a94568db9fe None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:38.910987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:38.915390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f543c5-d2b2-4b39-98ec-33c12897338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:38.915987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f543c5-d2b2-4b39-98ec-33c12897338e admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:38.916269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f543c5-d2b2-4b39-98ec-33c12897338e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:38.916545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f543c5-d2b2-4b39-98ec-33c12897338e admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:38.917175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f543c5-d2b2-4b39-98ec-33c12897338e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:38.919994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f543c5-d2b2-4b39-98ec-33c12897338e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:39.026733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1026/2070] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:38 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:39.030785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58760a0f-3fe4-4524-8555-8544325a2a4d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:39.036073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:39.041992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58760a0f-3fe4-4524-8555-8544325a2a4d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:39.103920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb7e2e-158c-475a-b5b4-dfbfd61e8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:39.104551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7e2e-158c-475a-b5b4-dfbfd61e8d48 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:39.104834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7e2e-158c-475a-b5b4-dfbfd61e8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:39.105113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7e2e-158c-475a-b5b4-dfbfd61e8d48 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:39.105760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb7e2e-158c-475a-b5b4-dfbfd61e8d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:39.107756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb7e2e-158c-475a-b5b4-dfbfd61e8d48 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:39.248911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1045/2071] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:39 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:39.253297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f543c5-d2b2-4b39-98ec-33c12897338e admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:39.264237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f543c5-d2b2-4b39-98ec-33c12897338e admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:39.269431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e226a-1018-4713-a7f4-663f7d18a653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:39.270131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e226a-1018-4713-a7f4-663f7d18a653 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:39.270508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e226a-1018-4713-a7f4-663f7d18a653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:39.270856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e226a-1018-4713-a7f4-663f7d18a653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:39.271581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e226a-1018-4713-a7f4-663f7d18a653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:39.273242 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e226a-1018-4713-a7f4-663f7d18a653 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:39.284147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1027/2072] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:39.288381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb7e2e-158c-475a-b5b4-dfbfd61e8d48 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:39.299605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb7e2e-158c-475a-b5b4-dfbfd61e8d48 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:39.304561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c49003-ffca-46bf-86a1-0c1d53bb1a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:39.305956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c49003-ffca-46bf-86a1-0c1d53bb1a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:39.306265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c49003-ffca-46bf-86a1-0c1d53bb1a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:39.307682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c49003-ffca-46bf-86a1-0c1d53bb1a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:39.307682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c49003-ffca-46bf-86a1-0c1d53bb1a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:39.308946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c49003-ffca-46bf-86a1-0c1d53bb1a2e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:39.319978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1046/2073] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:39.324327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e226a-1018-4713-a7f4-663f7d18a653 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:39.334946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e226a-1018-4713-a7f4-663f7d18a653 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:39.339686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f33498-2d62-4816-ba80-b48091c4e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:39.340325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f33498-2d62-4816-ba80-b48091c4e124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:39.340616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f33498-2d62-4816-ba80-b48091c4e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:39.340891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f33498-2d62-4816-ba80-b48091c4e124 admin admin] PATH_INFO: `/v3/projects/1eab3131b6f148b6bad4b0edeb447a5f/users/f7e5f2775904485fb92df62541992d5a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:39.355749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f33498-2d62-4816-ba80-b48091c4e124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eab3131b6f148b6bad4b0edeb447a5f, user_id=f7e5f2775904485fb92df62541992d5a, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:39.358478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f33498-2d62-4816-ba80-b48091c4e124 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:39.447951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1028/2074] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:39 2022] PUT /identity/v3/projects/1eab3131b6f148b6bad4b0edeb447a5f/users/f7e5f2775904485fb92df62541992d5a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:39.458650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1155647-4706-49f0-921e-2f93f7140477 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:39.458936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1155647-4706-49f0-921e-2f93f7140477 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:39.459211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1155647-4706-49f0-921e-2f93f7140477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:39.487517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b1155647-4706-49f0-921e-2f93f7140477 None None] MFA Rules not processed for user `f7e5f2775904485fb92df62541992d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:39.488721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b1155647-4706-49f0-921e-2f93f7140477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:39.559041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1047/2075] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:39.560214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f33498-2d62-4816-ba80-b48091c4e124 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:39.623419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f33498-2d62-4816-ba80-b48091c4e124 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:39.628123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece72a2-c7c0-4c53-abef-99e2445e0870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:39.628773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece72a2-c7c0-4c53-abef-99e2445e0870 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:39.629093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece72a2-c7c0-4c53-abef-99e2445e0870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:39.629372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece72a2-c7c0-4c53-abef-99e2445e0870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:39.630021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece72a2-c7c0-4c53-abef-99e2445e0870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:39.631965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece72a2-c7c0-4c53-abef-99e2445e0870 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:39.755179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1029/2076] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:39 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:39.757884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1155647-4706-49f0-921e-2f93f7140477 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:39.773718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1155647-4706-49f0-921e-2f93f7140477 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:39.844531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff72ecd-c413-4458-a52b-23f85a607a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:39.845229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff72ecd-c413-4458-a52b-23f85a607a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:39.852852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff72ecd-c413-4458-a52b-23f85a607a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:39.852852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff72ecd-c413-4458-a52b-23f85a607a36 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:39.852852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff72ecd-c413-4458-a52b-23f85a607a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:39.852852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff72ecd-c413-4458-a52b-23f85a607a36 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:39.994245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1048/2077] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:39 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:39.995225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece72a2-c7c0-4c53-abef-99e2445e0870 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:40.005397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece72a2-c7c0-4c53-abef-99e2445e0870 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:40.010824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfdd8f-cd65-4dcc-9fa4-cb1644aabe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:40.011554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfdd8f-cd65-4dcc-9fa4-cb1644aabe55 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:40.011841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfdd8f-cd65-4dcc-9fa4-cb1644aabe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:40.012117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfdd8f-cd65-4dcc-9fa4-cb1644aabe55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:40.012788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfdd8f-cd65-4dcc-9fa4-cb1644aabe55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:40.014723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfdd8f-cd65-4dcc-9fa4-cb1644aabe55 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:40.038335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1030/2078] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:40.043060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff72ecd-c413-4458-a52b-23f85a607a36 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:40.052779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff72ecd-c413-4458-a52b-23f85a607a36 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:40.058025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cddb96-8b94-45d0-99f3-9b456775ace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:40.058675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cddb96-8b94-45d0-99f3-9b456775ace5 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:40.058951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cddb96-8b94-45d0-99f3-9b456775ace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:40.065372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cddb96-8b94-45d0-99f3-9b456775ace5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:40.065372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cddb96-8b94-45d0-99f3-9b456775ace5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:40.065372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cddb96-8b94-45d0-99f3-9b456775ace5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:40.071846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1049/2079] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:40.076181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfdd8f-cd65-4dcc-9fa4-cb1644aabe55 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:40.086474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfdd8f-cd65-4dcc-9fa4-cb1644aabe55 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:40.091783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38ba90-bdd4-4401-9737-8ccb3dbda4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:40.096882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38ba90-bdd4-4401-9737-8ccb3dbda4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:40.096882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38ba90-bdd4-4401-9737-8ccb3dbda4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:40.096882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38ba90-bdd4-4401-9737-8ccb3dbda4cf admin admin] PATH_INFO: `/v3/projects/cafb9ee0255940f4ab9640881ddb35e7/users/1dbea8cd1c264d2cbc0c0d494eac0348/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:40.110539 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38ba90-bdd4-4401-9737-8ccb3dbda4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafb9ee0255940f4ab9640881ddb35e7, user_id=1dbea8cd1c264d2cbc0c0d494eac0348, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:40.111724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38ba90-bdd4-4401-9737-8ccb3dbda4cf admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:40.225465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1031/2080] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:40 2022] PUT /identity/v3/projects/cafb9ee0255940f4ab9640881ddb35e7/users/1dbea8cd1c264d2cbc0c0d494eac0348/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:40.237026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5951c-af52-4505-97b7-285c17a60662 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:40.237326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5951c-af52-4505-97b7-285c17a60662 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:40.237613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5951c-af52-4505-97b7-285c17a60662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:40.267085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-34a5951c-af52-4505-97b7-285c17a60662 None None] MFA Rules not processed for user `1dbea8cd1c264d2cbc0c0d494eac0348`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:40.268326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-34a5951c-af52-4505-97b7-285c17a60662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:40.335615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1050/2081] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:40.340553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38ba90-bdd4-4401-9737-8ccb3dbda4cf admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:40.413949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38ba90-bdd4-4401-9737-8ccb3dbda4cf admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:40.419050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d8aa8-4529-4a28-b72c-e8adfb77cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:40.419808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d8aa8-4529-4a28-b72c-e8adfb77cd27 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:40.419975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d8aa8-4529-4a28-b72c-e8adfb77cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:40.420233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d8aa8-4529-4a28-b72c-e8adfb77cd27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:40.420918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d8aa8-4529-4a28-b72c-e8adfb77cd27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:40.423175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d8aa8-4529-4a28-b72c-e8adfb77cd27 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:40.534873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1032/2082] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:40 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:40.538857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5951c-af52-4505-97b7-285c17a60662 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:40.549585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5951c-af52-4505-97b7-285c17a60662 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:40.605421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626fa53-a1c0-4873-b7f4-3c0f3f2b7856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:40.606097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626fa53-a1c0-4873-b7f4-3c0f3f2b7856 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:40.606427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626fa53-a1c0-4873-b7f4-3c0f3f2b7856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:40.606723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626fa53-a1c0-4873-b7f4-3c0f3f2b7856 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:40.607610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626fa53-a1c0-4873-b7f4-3c0f3f2b7856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:40.609621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626fa53-a1c0-4873-b7f4-3c0f3f2b7856 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:40.734621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1051/2083] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:40 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:40.738535 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d8aa8-4529-4a28-b72c-e8adfb77cd27 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:40.749651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d8aa8-4529-4a28-b72c-e8adfb77cd27 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:40.754058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdf6e0-6eba-4ad7-98c1-7020698daaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:40.754692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdf6e0-6eba-4ad7-98c1-7020698daaae admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:40.754971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdf6e0-6eba-4ad7-98c1-7020698daaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:40.755242 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdf6e0-6eba-4ad7-98c1-7020698daaae admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:40.755873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdf6e0-6eba-4ad7-98c1-7020698daaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:40.757443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdf6e0-6eba-4ad7-98c1-7020698daaae admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:40.767946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1033/2084] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:40.773666 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626fa53-a1c0-4873-b7f4-3c0f3f2b7856 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:40.784015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626fa53-a1c0-4873-b7f4-3c0f3f2b7856 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:40.788605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee2aa-b7b9-4182-9d49-952ea9cb2ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:40.789199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee2aa-b7b9-4182-9d49-952ea9cb2ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:40.789983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee2aa-b7b9-4182-9d49-952ea9cb2ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:40.790446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee2aa-b7b9-4182-9d49-952ea9cb2ffd admin admin] PATH_INFO: `/v3/projects/94d44f6e81624f03a3db81484433b9be/users/f4050f2979ff4c17b3accee4f9a408f5/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:40.806256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ee2aa-b7b9-4182-9d49-952ea9cb2ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d44f6e81624f03a3db81484433b9be, user_id=f4050f2979ff4c17b3accee4f9a408f5, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:40.809088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ee2aa-b7b9-4182-9d49-952ea9cb2ffd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:40.956341 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1052/2085] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:40 2022] PUT /identity/v3/projects/94d44f6e81624f03a3db81484433b9be/users/f4050f2979ff4c17b3accee4f9a408f5/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:40.960723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdf6e0-6eba-4ad7-98c1-7020698daaae admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:40.970887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdf6e0-6eba-4ad7-98c1-7020698daaae admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:41.035389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa7350-f08b-4ac9-8a2e-44109227ff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:41.035998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7350-f08b-4ac9-8a2e-44109227ff99 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:41.036282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7350-f08b-4ac9-8a2e-44109227ff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:41.036558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7350-f08b-4ac9-8a2e-44109227ff99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:41.037207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa7350-f08b-4ac9-8a2e-44109227ff99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:41.039052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa7350-f08b-4ac9-8a2e-44109227ff99 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:41.051660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1034/2086] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:41.055954 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee2aa-b7b9-4182-9d49-952ea9cb2ffd admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:41.066141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee2aa-b7b9-4182-9d49-952ea9cb2ffd admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:41.071318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c92d2-a1af-4fa6-aa27-0b08256fdb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:41.072148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c92d2-a1af-4fa6-aa27-0b08256fdb6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:41.072437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c92d2-a1af-4fa6-aa27-0b08256fdb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:41.072718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c92d2-a1af-4fa6-aa27-0b08256fdb6f admin admin] PATH_INFO: `/v3/projects/94d44f6e81624f03a3db81484433b9be/users/f4050f2979ff4c17b3accee4f9a408f5/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:41.074704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c92d2-a1af-4fa6-aa27-0b08256fdb6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d44f6e81624f03a3db81484433b9be, user_id=f4050f2979ff4c17b3accee4f9a408f5, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:41.077364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c92d2-a1af-4fa6-aa27-0b08256fdb6f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:41.089722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1053/2087] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:41 2022] PUT /identity/v3/projects/94d44f6e81624f03a3db81484433b9be/users/f4050f2979ff4c17b3accee4f9a408f5/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:41.100513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a40c7a-f9fe-459d-ae65-84b715184ab8 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:41.100990 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a40c7a-f9fe-459d-ae65-84b715184ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:41.101277 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a40c7a-f9fe-459d-ae65-84b715184ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:41.130254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-73a40c7a-f9fe-459d-ae65-84b715184ab8 None None] MFA Rules not processed for user `f4050f2979ff4c17b3accee4f9a408f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:41.131808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-73a40c7a-f9fe-459d-ae65-84b715184ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:41.201980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1035/2088] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:41.214955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c92d2-a1af-4fa6-aa27-0b08256fdb6f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:41.216696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3c1c92d2-a1af-4fa6-aa27-0b08256fdb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:41.275413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c92d2-a1af-4fa6-aa27-0b08256fdb6f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:41.279156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a5158-564d-451b-b9f4-b31088c377b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:41.279781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a5158-564d-451b-b9f4-b31088c377b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:41.280061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a5158-564d-451b-b9f4-b31088c377b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:41.280364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a5158-564d-451b-b9f4-b31088c377b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:41.336069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a5158-564d-451b-b9f4-b31088c377b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:41.338291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a5158-564d-451b-b9f4-b31088c377b6 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:41.348010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1054/2089] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:41.402449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:41.432080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:41.938941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a40c7a-f9fe-459d-ae65-84b715184ab8 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:41.938941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-73a40c7a-f9fe-459d-ae65-84b715184ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:41.953358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a40c7a-f9fe-459d-ae65-84b715184ab8 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:41.957195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407ea5f-a012-4cef-adcf-982021df8c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:41.957866 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407ea5f-a012-4cef-adcf-982021df8c17 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:41.958505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407ea5f-a012-4cef-adcf-982021df8c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:41.958851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407ea5f-a012-4cef-adcf-982021df8c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:41.962719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0407ea5f-a012-4cef-adcf-982021df8c17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:42.026932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407ea5f-a012-4cef-adcf-982021df8c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:42.028478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407ea5f-a012-4cef-adcf-982021df8c17 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:42.038172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1036/2090] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:42.574375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:43.214446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:43.431217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a5158-564d-451b-b9f4-b31088c377b6 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:43.439949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a5158-564d-451b-b9f4-b31088c377b6 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:43.448290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d096d-c6a3-4444-83bd-38c226001f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:43.448920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d096d-c6a3-4444-83bd-38c226001f01 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:43.449208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d096d-c6a3-4444-83bd-38c226001f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:43.449492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d096d-c6a3-4444-83bd-38c226001f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:43.514011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d096d-c6a3-4444-83bd-38c226001f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:43.515632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d096d-c6a3-4444-83bd-38c226001f01 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:43.526382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1055/2091] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:43.527823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:45.625701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:45.694481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df231d72-db49-4fbb-878b-de5242e5151c None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.694797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df231d72-db49-4fbb-878b-de5242e5151c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.695044 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df231d72-db49-4fbb-878b-de5242e5151c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.717276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-df231d72-db49-4fbb-878b-de5242e5151c None None] MFA Rules not processed for user `3310bbca6df0438e9f6103a227713e13`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:45.718533 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-df231d72-db49-4fbb-878b-de5242e5151c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:45.760229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d096d-c6a3-4444-83bd-38c226001f01 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:45.768822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d096d-c6a3-4444-83bd-38c226001f01 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:45.772450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43e160-0951-4175-aca8-4d62f4e217d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:45.773050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43e160-0951-4175-aca8-4d62f4e217d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.773331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43e160-0951-4175-aca8-4d62f4e217d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.773602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43e160-0951-4175-aca8-4d62f4e217d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.783615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43e160-0951-4175-aca8-4d62f4e217d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:45.783765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1037/2092] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:45.785188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43e160-0951-4175-aca8-4d62f4e217d7 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:45.795991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1056/2093] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:46.335671 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:48.859989 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:49.562896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:50.750147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df231d72-db49-4fbb-878b-de5242e5151c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:50.751577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-df231d72-db49-4fbb-878b-de5242e5151c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:50.823765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df231d72-db49-4fbb-878b-de5242e5151c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:50.828259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:50.828891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.829171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.834291 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] PATH_INFO: `/v3/users/51c39e88b1fc4b0fa4d99be23e3a3d3b` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.836788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c39e88b1fc4b0fa4d99be23e3a3d3b)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:50.839029 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:51.068597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c39e88b1fc4b0fa4d99be23e3a3d3b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:51.084407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c39e88b1fc4b0fa4d99be23e3a3d3b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:51.207918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c39e88b1fc4b0fa4d99be23e3a3d3b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:51.216479 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c39e88b1fc4b0fa4d99be23e3a3d3b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:51.217219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c39e88b1fc4b0fa4d99be23e3a3d3b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:51.223152 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1038/2094] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:50 2022] DELETE /identity/v3/users/51c39e88b1fc4b0fa4d99be23e3a3d3b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:51.229178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90785f23-5b5b-4f4e-9341-be4723437f59 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:51.233011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90785f23-5b5b-4f4e-9341-be4723437f59 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:51.233011 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90785f23-5b5b-4f4e-9341-be4723437f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:51.250813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-90785f23-5b5b-4f4e-9341-be4723437f59 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:51.251942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-90785f23-5b5b-4f4e-9341-be4723437f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:51.320142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1057/2095] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:51.329708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:51.331208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:51.404218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028927ac-b6db-46e4-95e7-845320e93725 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:51.408121 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8292bb8-15ec-4529-86a4-aa437372e626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:51.408737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8292bb8-15ec-4529-86a4-aa437372e626 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:51.409023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8292bb8-15ec-4529-86a4-aa437372e626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:51.409298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8292bb8-15ec-4529-86a4-aa437372e626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:51.419718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8292bb8-15ec-4529-86a4-aa437372e626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:51.421272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8292bb8-15ec-4529-86a4-aa437372e626 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:51.431780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1039/2096] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:51.488348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:51.875764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90785f23-5b5b-4f4e-9341-be4723437f59 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:51.877209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-90785f23-5b5b-4f4e-9341-be4723437f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:51.895149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90785f23-5b5b-4f4e-9341-be4723437f59 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:51.907412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:51.908518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:51.909040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:51.909557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] PATH_INFO: `/v3/projects/b7922afc8be042fcadd3185770a8275a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:51.911649 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7922afc8be042fcadd3185770a8275a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:51.915638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:52.101550 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7922afc8be042fcadd3185770a8275a', 'request_id': 'req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.108107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7922afc8be042fcadd3185770a8275a', 'request_id': 'req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.185767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7922afc8be042fcadd3185770a8275a', 'request_id': 'req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.197887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] The token cache is being invalidate because project b7922afc8be042fcadd3185770a8275a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:52.198186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.198876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.203795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1058/2097] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:51 2022] DELETE /identity/v3/projects/b7922afc8be042fcadd3185770a8275a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:52.205060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8292bb8-15ec-4529-86a4-aa437372e626 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:52.217327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8292bb8-15ec-4529-86a4-aa437372e626 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:52.272445 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:52.329408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:52.330051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:52.330376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:52.330656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] PATH_INFO: `/v3/users/a037a39c64d74103b3819f494453e7cc` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:52.331819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a037a39c64d74103b3819f494453e7cc)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:52.333967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:52.440696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:52.442575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:52.456719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faed5ad-f9ab-44f8-bccb-8a4ef8b311fc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:52.461928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:52.462589 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:52.463037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:52.463461 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] PATH_INFO: `/v3/users/f7e5f2775904485fb92df62541992d5a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:52.466117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e5f2775904485fb92df62541992d5a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:52.466740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:52.538816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a037a39c64d74103b3819f494453e7cc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.553099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a037a39c64d74103b3819f494453e7cc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.699783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a037a39c64d74103b3819f494453e7cc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.707408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a037a39c64d74103b3819f494453e7cc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.708161 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-2351fff7-2999-4cdd-bb4c-5c6dd58f9a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a037a39c64d74103b3819f494453e7cc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.715138 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1040/2098] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:52 2022] DELETE /identity/v3/users/a037a39c64d74103b3819f494453e7cc => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:52.756356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e5f2775904485fb92df62541992d5a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.757366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e5f2775904485fb92df62541992d5a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.765422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e5f2775904485fb92df62541992d5a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.780545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e5f2775904485fb92df62541992d5a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.904752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e5f2775904485fb92df62541992d5a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:52.911060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1059/2099] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:52 2022] DELETE /identity/v3/users/f7e5f2775904485fb92df62541992d5a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:52.916353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c58d7-ddb6-4121-8204-2d2ec8b32c7c None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:52.916709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c58d7-ddb6-4121-8204-2d2ec8b32c7c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:52.916996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c58d7-ddb6-4121-8204-2d2ec8b32c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:52.937845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-309c58d7-ddb6-4121-8204-2d2ec8b32c7c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:52.939187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-309c58d7-ddb6-4121-8204-2d2ec8b32c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:53.014034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1041/2100] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:53.023699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:53.026922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:53.087767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5453d-02fa-47ee-87a9-930bf7187d96 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:53.091946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a1bff-7594-4c6b-838d-5b2de2dfcd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:53.092563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a1bff-7594-4c6b-838d-5b2de2dfcd5d service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.100043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a1bff-7594-4c6b-838d-5b2de2dfcd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.100043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a1bff-7594-4c6b-838d-5b2de2dfcd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.106114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a1bff-7594-4c6b-838d-5b2de2dfcd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:53.107987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a1bff-7594-4c6b-838d-5b2de2dfcd5d service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:53.119403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1060/2101] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:53.221287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c58d7-ddb6-4121-8204-2d2ec8b32c7c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:53.223870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-309c58d7-ddb6-4121-8204-2d2ec8b32c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:53.248827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:53.260018 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c58d7-ddb6-4121-8204-2d2ec8b32c7c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:53.265750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:53.266446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.266726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.266998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] PATH_INFO: `/v3/projects/d790f94fb2954320a6b901d7a32c6766` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.268114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d790f94fb2954320a6b901d7a32c6766)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:53.270294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:53.410982 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd790f94fb2954320a6b901d7a32c6766', 'request_id': 'req-838ee03a-66c2-44d8-9ef9-c9876756d073'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.531044 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd790f94fb2954320a6b901d7a32c6766', 'request_id': 'req-838ee03a-66c2-44d8-9ef9-c9876756d073'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.538444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd790f94fb2954320a6b901d7a32c6766', 'request_id': 'req-838ee03a-66c2-44d8-9ef9-c9876756d073'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.551104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] The token cache is being invalidate because project d790f94fb2954320a6b901d7a32c6766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:53.551396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.552047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-838ee03a-66c2-44d8-9ef9-c9876756d073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.553528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1042/2102] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:53 2022] DELETE /identity/v3/projects/d790f94fb2954320a6b901d7a32c6766 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:53.559908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634aa2d-b4b0-4ead-b0f8-fe3fff867f20 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.560389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634aa2d-b4b0-4ead-b0f8-fe3fff867f20 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.560524 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634aa2d-b4b0-4ead-b0f8-fe3fff867f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.580851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2634aa2d-b4b0-4ead-b0f8-fe3fff867f20 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:53.581966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2634aa2d-b4b0-4ead-b0f8-fe3fff867f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:53.640126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1061/2103] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:53.648553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc29a-7eeb-4c1a-8363-2125c2a444cb None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.649575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc29a-7eeb-4c1a-8363-2125c2a444cb None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.649893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc29a-7eeb-4c1a-8363-2125c2a444cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.671301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c2fdc29a-7eeb-4c1a-8363-2125c2a444cb None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:53.674277 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c2fdc29a-7eeb-4c1a-8363-2125c2a444cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:53.682912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1043/2104] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:53.687311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634aa2d-b4b0-4ead-b0f8-fe3fff867f20 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:53.697484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634aa2d-b4b0-4ead-b0f8-fe3fff867f20 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:53.702077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73081bc9-a7db-440e-829a-9115edbbecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:53.702713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73081bc9-a7db-440e-829a-9115edbbecde admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.702999 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73081bc9-a7db-440e-829a-9115edbbecde admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.703275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73081bc9-a7db-440e-829a-9115edbbecde admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.703916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73081bc9-a7db-440e-829a-9115edbbecde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:53.704221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73081bc9-a7db-440e-829a-9115edbbecde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:53.705824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73081bc9-a7db-440e-829a-9115edbbecde admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:53.721720 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1062/2105] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:53.725960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc29a-7eeb-4c1a-8363-2125c2a444cb None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:53.726124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73081bc9-a7db-440e-829a-9115edbbecde admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:53.728403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c2fdc29a-7eeb-4c1a-8363-2125c2a444cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:53.740321 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73081bc9-a7db-440e-829a-9115edbbecde admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:53.746699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bb0fb-dbe9-493d-8218-13478cfec378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:53.747487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bb0fb-dbe9-493d-8218-13478cfec378 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.747774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bb0fb-dbe9-493d-8218-13478cfec378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.748286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bb0fb-dbe9-493d-8218-13478cfec378 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.748939 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bb0fb-dbe9-493d-8218-13478cfec378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:53.750817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bb0fb-dbe9-493d-8218-13478cfec378 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:53.757434 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc29a-7eeb-4c1a-8363-2125c2a444cb None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:53.763353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:53.763998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.764286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.764571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] PATH_INFO: `/v3/projects/1eab3131b6f148b6bad4b0edeb447a5f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.765708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eab3131b6f148b6bad4b0edeb447a5f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:53.767859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:53.915773 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1063/2106] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:53 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:53.916727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bb0fb-dbe9-493d-8218-13478cfec378 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:53.923604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eab3131b6f148b6bad4b0edeb447a5f', 'request_id': 'req-84db68e0-13c6-4619-a1fb-f9334432c677'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.978710 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bb0fb-dbe9-493d-8218-13478cfec378 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:53.983387 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88051b-7407-47be-90f9-27751455ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:53.984038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88051b-7407-47be-90f9-27751455ddd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.984322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88051b-7407-47be-90f9-27751455ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.984602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88051b-7407-47be-90f9-27751455ddd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.985225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88051b-7407-47be-90f9-27751455ddd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:53.987182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88051b-7407-47be-90f9-27751455ddd9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:53.996673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eab3131b6f148b6bad4b0edeb447a5f', 'request_id': 'req-84db68e0-13c6-4619-a1fb-f9334432c677'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:54.002740 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eab3131b6f148b6bad4b0edeb447a5f', 'request_id': 'req-84db68e0-13c6-4619-a1fb-f9334432c677'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:54.014678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] The token cache is being invalidate because project 1eab3131b6f148b6bad4b0edeb447a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:54.014971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:54.015655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:54.017214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1044/2107] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:53 2022] DELETE /identity/v3/projects/1eab3131b6f148b6bad4b0edeb447a5f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:54.021085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:54.022414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:54.086162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db68e0-13c6-4619-a1fb-f9334432c677 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:54.089100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1064/2108] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:53 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:54.091114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:54.091827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:54.092202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:54.092487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] PATH_INFO: `/v3/users/1dbea8cd1c264d2cbc0c0d494eac0348` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:54.093137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88051b-7407-47be-90f9-27751455ddd9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:54.093659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dbea8cd1c264d2cbc0c0d494eac0348)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:54.094831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2b88051b-7407-47be-90f9-27751455ddd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:54.095747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:54.107087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88051b-7407-47be-90f9-27751455ddd9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:54.111983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c9337-0de4-41a7-b1bd-5e73fc52872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:54.112591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9337-0de4-41a7-b1bd-5e73fc52872f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:54.112878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9337-0de4-41a7-b1bd-5e73fc52872f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:54.113244 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9337-0de4-41a7-b1bd-5e73fc52872f admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:54.113893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c9337-0de4-41a7-b1bd-5e73fc52872f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:54.118291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c9337-0de4-41a7-b1bd-5e73fc52872f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:54.129013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1065/2109] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:54.132998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c9337-0de4-41a7-b1bd-5e73fc52872f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:54.143496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c9337-0de4-41a7-b1bd-5e73fc52872f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:54.148121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef06a9e-7072-4274-881c-f476469475ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:54.148717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef06a9e-7072-4274-881c-f476469475ec admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:54.149118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef06a9e-7072-4274-881c-f476469475ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:54.149401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef06a9e-7072-4274-881c-f476469475ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:54.150028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef06a9e-7072-4274-881c-f476469475ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:54.151674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef06a9e-7072-4274-881c-f476469475ec admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:54.163464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1066/2110] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:54.168213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef06a9e-7072-4274-881c-f476469475ec admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:54.178460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef06a9e-7072-4274-881c-f476469475ec admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:54.186107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cb6a5-91c9-43f5-b280-f30a3a0ab70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:54.187160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb6a5-91c9-43f5-b280-f30a3a0ab70a admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:54.187640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb6a5-91c9-43f5-b280-f30a3a0ab70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:54.187924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb6a5-91c9-43f5-b280-f30a3a0ab70a admin admin] PATH_INFO: `/v3/projects/8123121387be4bea8e4423da188443c1/users/8ce7daea6fac45e79028cfd370bf0352/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:54.202953 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cb6a5-91c9-43f5-b280-f30a3a0ab70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8123121387be4bea8e4423da188443c1, user_id=8ce7daea6fac45e79028cfd370bf0352, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:54.205611 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cb6a5-91c9-43f5-b280-f30a3a0ab70a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:54.329140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1067/2111] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:54 2022] PUT /identity/v3/projects/8123121387be4bea8e4423da188443c1/users/8ce7daea6fac45e79028cfd370bf0352/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:54.334565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e329a5-8114-4dd5-b617-99ff678c8e25 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:54.338123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e329a5-8114-4dd5-b617-99ff678c8e25 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:54.338123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e329a5-8114-4dd5-b617-99ff678c8e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:54.350467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dbea8cd1c264d2cbc0c0d494eac0348'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:54.358818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-91e329a5-8114-4dd5-b617-99ff678c8e25 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:54.360216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-91e329a5-8114-4dd5-b617-99ff678c8e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:54.364711 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dbea8cd1c264d2cbc0c0d494eac0348'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:54.428584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1068/2112] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:54.440519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e329a5-8114-4dd5-b617-99ff678c8e25 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:54.441933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-91e329a5-8114-4dd5-b617-99ff678c8e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:54.472522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dbea8cd1c264d2cbc0c0d494eac0348'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:54.480557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dbea8cd1c264d2cbc0c0d494eac0348'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:54.481570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dbea8cd1c264d2cbc0c0d494eac0348'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:54.487867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1045/2113] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:54 2022] DELETE /identity/v3/users/1dbea8cd1c264d2cbc0c0d494eac0348 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:54.525533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e329a5-8114-4dd5-b617-99ff678c8e25 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:54.616896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa146f5e-a655-4e9f-a339-e720718b5369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:54.618585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa146f5e-a655-4e9f-a339-e720718b5369 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:54.619185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa146f5e-a655-4e9f-a339-e720718b5369 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:54.619479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa146f5e-a655-4e9f-a339-e720718b5369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:54.621653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aa146f5e-a655-4e9f-a339-e720718b5369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:54.626214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:54.711108 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa146f5e-a655-4e9f-a339-e720718b5369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:54.712629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa146f5e-a655-4e9f-a339-e720718b5369 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:54.724097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1069/2114] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:55.100885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:55.103612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:55.118981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900da0f7-05ff-40f3-b168-0dd419235a79 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:55.123208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:55.123845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:55.124126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:55.124516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] PATH_INFO: `/v3/projects/cafb9ee0255940f4ab9640881ddb35e7` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:55.125581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafb9ee0255940f4ab9640881ddb35e7)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:55.128583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:55.316469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafb9ee0255940f4ab9640881ddb35e7', 'request_id': 'req-78247d50-ad3e-4f63-8485-9ca5cd57105d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.396828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafb9ee0255940f4ab9640881ddb35e7', 'request_id': 'req-78247d50-ad3e-4f63-8485-9ca5cd57105d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.412739 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafb9ee0255940f4ab9640881ddb35e7', 'request_id': 'req-78247d50-ad3e-4f63-8485-9ca5cd57105d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.417380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] The token cache is being invalidate because project cafb9ee0255940f4ab9640881ddb35e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:55.417783 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.418975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.420045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1046/2115] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:55 2022] DELETE /identity/v3/projects/cafb9ee0255940f4ab9640881ddb35e7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:55.424160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa146f5e-a655-4e9f-a339-e720718b5369 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:55.442745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa146f5e-a655-4e9f-a339-e720718b5369 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:55.498622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:55.499261 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:55.499549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:55.499829 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] PATH_INFO: `/v3/users/f4050f2979ff4c17b3accee4f9a408f5` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:55.500980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4050f2979ff4c17b3accee4f9a408f5)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:55.503000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:55.705645 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:55.800555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4050f2979ff4c17b3accee4f9a408f5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.801568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4050f2979ff4c17b3accee4f9a408f5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.810034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4050f2979ff4c17b3accee4f9a408f5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.823784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4050f2979ff4c17b3accee4f9a408f5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:56.048054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-225d461c-df2f-46e3-8292-e4c4a05c6177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4050f2979ff4c17b3accee4f9a408f5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:56.065281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1070/2116] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:55 2022] DELETE /identity/v3/users/f4050f2979ff4c17b3accee4f9a408f5 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:56.465606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:56.668589 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:56.670403 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:56.685916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78247d50-ad3e-4f63-8485-9ca5cd57105d admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:56.755326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:56.755994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:56.756476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:56.756753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] PATH_INFO: `/v3/projects/94d44f6e81624f03a3db81484433b9be` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:56.759461 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d44f6e81624f03a3db81484433b9be)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:56.761583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:56.965735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d44f6e81624f03a3db81484433b9be', 'request_id': 'req-a50786af-715a-496e-85c9-61bd2cfe2c60'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.083830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d44f6e81624f03a3db81484433b9be', 'request_id': 'req-a50786af-715a-496e-85c9-61bd2cfe2c60'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.091910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d44f6e81624f03a3db81484433b9be', 'request_id': 'req-a50786af-715a-496e-85c9-61bd2cfe2c60'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.113697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] The token cache is being invalidate because project 94d44f6e81624f03a3db81484433b9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:57.115480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.115661 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a50786af-715a-496e-85c9-61bd2cfe2c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.118630 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1047/2117] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:56 2022] DELETE /identity/v3/projects/94d44f6e81624f03a3db81484433b9be => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:57.123286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f3ce6-a94c-4d9f-886a-41ee7d3defd7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.123804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f3ce6-a94c-4d9f-886a-41ee7d3defd7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.124138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f3ce6-a94c-4d9f-886a-41ee7d3defd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.164255 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3f8f3ce6-a94c-4d9f-886a-41ee7d3defd7 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:57.167271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3f8f3ce6-a94c-4d9f-886a-41ee7d3defd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.292703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1071/2118] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:57.301708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed142fcf-6bc5-40e3-abb2-0cde273640e8 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.302002 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed142fcf-6bc5-40e3-abb2-0cde273640e8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.302330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed142fcf-6bc5-40e3-abb2-0cde273640e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.327263 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ed142fcf-6bc5-40e3-abb2-0cde273640e8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:57.328568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ed142fcf-6bc5-40e3-abb2-0cde273640e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.337304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1048/2119] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:57.341656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f3ce6-a94c-4d9f-886a-41ee7d3defd7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.352652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f3ce6-a94c-4d9f-886a-41ee7d3defd7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.369065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703f2d8-0e58-41c5-acd3-ace55c53a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.369869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703f2d8-0e58-41c5-acd3-ace55c53a257 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.370239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703f2d8-0e58-41c5-acd3-ace55c53a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.370582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703f2d8-0e58-41c5-acd3-ace55c53a257 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.371307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703f2d8-0e58-41c5-acd3-ace55c53a257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:57.371982 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703f2d8-0e58-41c5-acd3-ace55c53a257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.375017 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703f2d8-0e58-41c5-acd3-ace55c53a257 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.392378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1072/2120] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:57.396837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed142fcf-6bc5-40e3-abb2-0cde273640e8 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.407891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed142fcf-6bc5-40e3-abb2-0cde273640e8 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.422697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804fb4f-c7d5-4d76-84c9-25754b2d6797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.423840 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804fb4f-c7d5-4d76-84c9-25754b2d6797 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.424326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804fb4f-c7d5-4d76-84c9-25754b2d6797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.424816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804fb4f-c7d5-4d76-84c9-25754b2d6797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.425649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804fb4f-c7d5-4d76-84c9-25754b2d6797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.428513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804fb4f-c7d5-4d76-84c9-25754b2d6797 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.608518 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1049/2121] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:57 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:57.630621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703f2d8-0e58-41c5-acd3-ace55c53a257 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.660634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703f2d8-0e58-41c5-acd3-ace55c53a257 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.777986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff64f23-e8aa-4240-a0bc-6017d84f996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.778226 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff64f23-e8aa-4240-a0bc-6017d84f996f admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.778489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff64f23-e8aa-4240-a0bc-6017d84f996f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.778894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff64f23-e8aa-4240-a0bc-6017d84f996f admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.779684 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff64f23-e8aa-4240-a0bc-6017d84f996f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.781501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff64f23-e8aa-4240-a0bc-6017d84f996f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.819925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:57.991595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804fb4f-c7d5-4d76-84c9-25754b2d6797 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.993848 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a804fb4f-c7d5-4d76-84c9-25754b2d6797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.998851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1073/2122] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:57 2022] POST /identity/v3/users => generated 288 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:58.002828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff64f23-e8aa-4240-a0bc-6017d84f996f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:58.011980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804fb4f-c7d5-4d76-84c9-25754b2d6797 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:58.017812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:58.018535 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.018865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.019306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] PATH_INFO: `/v3/users/2f3f82f9da1941198f81f72052c27b80` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.020766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3f82f9da1941198f81f72052c27b80)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:58.023217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:58.027000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff64f23-e8aa-4240-a0bc-6017d84f996f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:58.051921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ba30-43ff-4d30-b46e-c78776fc3e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:58.052629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ba30-43ff-4d30-b46e-c78776fc3e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.052988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ba30-43ff-4d30-b46e-c78776fc3e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.053334 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ba30-43ff-4d30-b46e-c78776fc3e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.054146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3ba30-43ff-4d30-b46e-c78776fc3e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:58.057179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3ba30-43ff-4d30-b46e-c78776fc3e3d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:58.071412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1074/2123] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:58.078613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ba30-43ff-4d30-b46e-c78776fc3e3d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:58.090082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ba30-43ff-4d30-b46e-c78776fc3e3d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:58.094933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac1465-1a75-4793-a7a8-254dd4702197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:58.095541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac1465-1a75-4793-a7a8-254dd4702197 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.095824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac1465-1a75-4793-a7a8-254dd4702197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.098358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac1465-1a75-4793-a7a8-254dd4702197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.098358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac1465-1a75-4793-a7a8-254dd4702197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:58.098358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac1465-1a75-4793-a7a8-254dd4702197 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:58.111326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1075/2124] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:58.113729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac1465-1a75-4793-a7a8-254dd4702197 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:58.127610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac1465-1a75-4793-a7a8-254dd4702197 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:58.129640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae587bcb-2ad5-48aa-966c-b83a4cdbc9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:58.131838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae587bcb-2ad5-48aa-966c-b83a4cdbc9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.132125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae587bcb-2ad5-48aa-966c-b83a4cdbc9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.132406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae587bcb-2ad5-48aa-966c-b83a4cdbc9b2 admin admin] PATH_INFO: `/v3/projects/ae4da7e5e9a540b29c115c3520736f47/users/33f0771372bf4d90a5798c97aae10002/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.168545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae587bcb-2ad5-48aa-966c-b83a4cdbc9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4da7e5e9a540b29c115c3520736f47, user_id=33f0771372bf4d90a5798c97aae10002, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:58.172759 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae587bcb-2ad5-48aa-966c-b83a4cdbc9b2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:58.295435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1076/2125] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:58 2022] PUT /identity/v3/projects/ae4da7e5e9a540b29c115c3520736f47/users/33f0771372bf4d90a5798c97aae10002/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:58.307608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1f914-0fae-417a-82bb-23837a74df89 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.307608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1f914-0fae-417a-82bb-23837a74df89 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.307608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1f914-0fae-417a-82bb-23837a74df89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.338097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5da1f914-0fae-417a-82bb-23837a74df89 None None] MFA Rules not processed for user `33f0771372bf4d90a5798c97aae10002`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:58.339417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5da1f914-0fae-417a-82bb-23837a74df89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:58.362701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3f82f9da1941198f81f72052c27b80'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.386860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3f82f9da1941198f81f72052c27b80'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.430668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1077/2126] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:58.438521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1f914-0fae-417a-82bb-23837a74df89 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:58.440272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5da1f914-0fae-417a-82bb-23837a74df89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:58.482714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3f82f9da1941198f81f72052c27b80'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.491344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3f82f9da1941198f81f72052c27b80'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.498358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-9bc39ec0-5c32-48d9-bad2-9768aa04a972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3f82f9da1941198f81f72052c27b80'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.499659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1050/2127] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:57 2022] DELETE /identity/v3/users/2f3f82f9da1941198f81f72052c27b80 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:58.503868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c5d34-566b-4c55-ae19-df331d68ab22 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.504158 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c5d34-566b-4c55-ae19-df331d68ab22 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.504436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c5d34-566b-4c55-ae19-df331d68ab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.523530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1f914-0fae-417a-82bb-23837a74df89 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:58.543317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-867c5d34-566b-4c55-ae19-df331d68ab22 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:58.544710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-867c5d34-566b-4c55-ae19-df331d68ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:58.599202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c9b33-0391-4f28-81b4-956ea95c4185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:58.600857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c9b33-0391-4f28-81b4-956ea95c4185 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.601278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c9b33-0391-4f28-81b4-956ea95c4185 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.601686 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c9b33-0391-4f28-81b4-956ea95c4185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.605118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f53c9b33-0391-4f28-81b4-956ea95c4185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:58.703607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1051/2128] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:58.714971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c5d34-566b-4c55-ae19-df331d68ab22 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:58.716553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-867c5d34-566b-4c55-ae19-df331d68ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:58.720856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c9b33-0391-4f28-81b4-956ea95c4185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:58.728211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c9b33-0391-4f28-81b4-956ea95c4185 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:58.743391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1078/2129] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:58.812544 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c5d34-566b-4c55-ae19-df331d68ab22 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:58.840851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9db7-10c5-4f78-a3d3-acb8c73abd6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:58.841474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9db7-10c5-4f78-a3d3-acb8c73abd6c service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.842323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9db7-10c5-4f78-a3d3-acb8c73abd6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.842323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9db7-10c5-4f78-a3d3-acb8c73abd6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.860215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c9db7-10c5-4f78-a3d3-acb8c73abd6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:58.861681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c9db7-10c5-4f78-a3d3-acb8c73abd6c service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:58.915426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1052/2130] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:59.162988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:59.571475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c9b33-0391-4f28-81b4-956ea95c4185 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:59.573179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f53c9b33-0391-4f28-81b4-956ea95c4185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:59.588797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c9b33-0391-4f28-81b4-956ea95c4185 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:59.595322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:59.596323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:59.597442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:59.597877 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] PATH_INFO: `/v3/projects/15ec2e4f9a3248f2b5132aea33e97139` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:59.599397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ec2e4f9a3248f2b5132aea33e97139)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:59.601527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:59.787466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ec2e4f9a3248f2b5132aea33e97139', 'request_id': 'req-3b41b1d2-2040-4ec6-b018-15551ec4eb71'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.796436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ec2e4f9a3248f2b5132aea33e97139', 'request_id': 'req-3b41b1d2-2040-4ec6-b018-15551ec4eb71'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.980134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ec2e4f9a3248f2b5132aea33e97139', 'request_id': 'req-3b41b1d2-2040-4ec6-b018-15551ec4eb71'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.994793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] The token cache is being invalidate because project 15ec2e4f9a3248f2b5132aea33e97139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:59.995442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.999232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3b41b1d2-2040-4ec6-b018-15551ec4eb71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.007795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1079/2131] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:59 2022] DELETE /identity/v3/projects/15ec2e4f9a3248f2b5132aea33e97139 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:00.012534 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9db7-10c5-4f78-a3d3-acb8c73abd6c service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:00.044877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9db7-10c5-4f78-a3d3-acb8c73abd6c service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:00.134784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:00.135561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:00.135849 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:00.136120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] PATH_INFO: `/v3/users/8c070f2fee4e49cf9ba9356f60b7a8f9` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:00.137723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c070f2fee4e49cf9ba9356f60b7a8f9)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:00.139705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:00.446999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c070f2fee4e49cf9ba9356f60b7a8f9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.467296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c070f2fee4e49cf9ba9356f60b7a8f9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.539728 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c070f2fee4e49cf9ba9356f60b7a8f9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.549446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c070f2fee4e49cf9ba9356f60b7a8f9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.550810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c070f2fee4e49cf9ba9356f60b7a8f9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.567908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1053/2132] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:00 2022] DELETE /identity/v3/users/8c070f2fee4e49cf9ba9356f60b7a8f9 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:00.922983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dbe5c-9133-4123-a294-0db8024a7db6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:00.923445 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dbe5c-9133-4123-a294-0db8024a7db6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:00.923664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dbe5c-9133-4123-a294-0db8024a7db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:00.962968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fa3dbe5c-9133-4123-a294-0db8024a7db6 None None] MFA Rules not processed for user `33f0771372bf4d90a5798c97aae10002`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:00.967246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fa3dbe5c-9133-4123-a294-0db8024a7db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:01.032112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:01.078286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1080/2133] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:01.332111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:01.333993 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:01.441798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37d12-5941-4648-8af8-bf05ef1a8d48 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:01.449699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:01.452709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.453033 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.453920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] PATH_INFO: `/v3/projects/2c62b757d9bc447a896e6b42ab44422d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.455280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c62b757d9bc447a896e6b42ab44422d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:01.464077 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:01.623251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c62b757d9bc447a896e6b42ab44422d', 'request_id': 'req-efd0cea1-73f8-4690-b582-b01f2a647e46'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.763730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c62b757d9bc447a896e6b42ab44422d', 'request_id': 'req-efd0cea1-73f8-4690-b582-b01f2a647e46'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.772188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c62b757d9bc447a896e6b42ab44422d', 'request_id': 'req-efd0cea1-73f8-4690-b582-b01f2a647e46'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.786444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] The token cache is being invalidate because project 2c62b757d9bc447a896e6b42ab44422d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:01.787062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.787936 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-efd0cea1-73f8-4690-b582-b01f2a647e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.790903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1054/2134] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:01 2022] DELETE /identity/v3/projects/2c62b757d9bc447a896e6b42ab44422d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:01.797862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b48e4-4a48-4188-8e45-8df693b68e6c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.798587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b48e4-4a48-4188-8e45-8df693b68e6c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.799167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b48e4-4a48-4188-8e45-8df693b68e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.868751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-445b48e4-4a48-4188-8e45-8df693b68e6c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:01.870272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-445b48e4-4a48-4188-8e45-8df693b68e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:01.969993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1081/2135] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:01.978416 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331c3b1-a13f-4216-9a22-5be2a3ab7fad None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.978709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331c3b1-a13f-4216-9a22-5be2a3ab7fad None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.979013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331c3b1-a13f-4216-9a22-5be2a3ab7fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.001010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-d331c3b1-a13f-4216-9a22-5be2a3ab7fad None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:02.002444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d331c3b1-a13f-4216-9a22-5be2a3ab7fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:02.014585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1055/2136] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:02.016049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b48e4-4a48-4188-8e45-8df693b68e6c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:02.027849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b48e4-4a48-4188-8e45-8df693b68e6c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:02.033192 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289fc7d-4bef-494a-9534-53e7be83fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:02.033984 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fc7d-4bef-494a-9534-53e7be83fe99 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.034307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fc7d-4bef-494a-9534-53e7be83fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.034587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fc7d-4bef-494a-9534-53e7be83fe99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.035391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289fc7d-4bef-494a-9534-53e7be83fe99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:02.035704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289fc7d-4bef-494a-9534-53e7be83fe99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:02.037356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289fc7d-4bef-494a-9534-53e7be83fe99 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:02.054777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1082/2137] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:02.056117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331c3b1-a13f-4216-9a22-5be2a3ab7fad None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:02.067077 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331c3b1-a13f-4216-9a22-5be2a3ab7fad None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:02.073924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663aa8b-c6ad-4cbc-a48c-7f35ada31faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:02.074521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663aa8b-c6ad-4cbc-a48c-7f35ada31faf admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.074836 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663aa8b-c6ad-4cbc-a48c-7f35ada31faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.075084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663aa8b-c6ad-4cbc-a48c-7f35ada31faf admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.076057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663aa8b-c6ad-4cbc-a48c-7f35ada31faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:02.078232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663aa8b-c6ad-4cbc-a48c-7f35ada31faf admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:02.135795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:02.172923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1056/2138] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:02 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:02.181802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289fc7d-4bef-494a-9534-53e7be83fe99 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:02.195774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289fc7d-4bef-494a-9534-53e7be83fe99 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:02.281136 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289475-d6c5-4337-a258-192116f51d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:02.281729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289475-d6c5-4337-a258-192116f51d67 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.282067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289475-d6c5-4337-a258-192116f51d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.282382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289475-d6c5-4337-a258-192116f51d67 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.283110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf289475-d6c5-4337-a258-192116f51d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:02.285357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf289475-d6c5-4337-a258-192116f51d67 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:02.417885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1083/2139] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:02 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:02.419596 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663aa8b-c6ad-4cbc-a48c-7f35ada31faf admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:02.434457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663aa8b-c6ad-4cbc-a48c-7f35ada31faf admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:02.440741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c0b20-6a8e-44d5-b5c4-6ec2c0c96173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:02.441793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c0b20-6a8e-44d5-b5c4-6ec2c0c96173 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.442794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c0b20-6a8e-44d5-b5c4-6ec2c0c96173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.443335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c0b20-6a8e-44d5-b5c4-6ec2c0c96173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.444240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c0b20-6a8e-44d5-b5c4-6ec2c0c96173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:02.446470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c0b20-6a8e-44d5-b5c4-6ec2c0c96173 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:02.473893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1057/2140] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:02.476601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289475-d6c5-4337-a258-192116f51d67 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:02.489151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289475-d6c5-4337-a258-192116f51d67 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:02.499524 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0c414-5db7-46e5-a528-8ed9e482a3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:02.499524 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0c414-5db7-46e5-a528-8ed9e482a3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.499524 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0c414-5db7-46e5-a528-8ed9e482a3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.499524 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0c414-5db7-46e5-a528-8ed9e482a3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.499804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0c414-5db7-46e5-a528-8ed9e482a3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:02.499804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0c414-5db7-46e5-a528-8ed9e482a3cb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:02.512883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1084/2141] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:02.520413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c0b20-6a8e-44d5-b5c4-6ec2c0c96173 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:02.542006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c0b20-6a8e-44d5-b5c4-6ec2c0c96173 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:02.549964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354db7f4-4d00-49d4-ba73-a1e41ff8cbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:02.550719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354db7f4-4d00-49d4-ba73-a1e41ff8cbb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.551008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354db7f4-4d00-49d4-ba73-a1e41ff8cbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.551289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354db7f4-4d00-49d4-ba73-a1e41ff8cbb7 admin admin] PATH_INFO: `/v3/projects/4a256e06a7ed45858761440d49b1a2a4/users/dc004969e8344bbd8836829614500f6f/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.568543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354db7f4-4d00-49d4-ba73-a1e41ff8cbb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a256e06a7ed45858761440d49b1a2a4, user_id=dc004969e8344bbd8836829614500f6f, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:02.571306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354db7f4-4d00-49d4-ba73-a1e41ff8cbb7 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:02.681887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1058/2142] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:02 2022] PUT /identity/v3/projects/4a256e06a7ed45858761440d49b1a2a4/users/dc004969e8344bbd8836829614500f6f/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:02.694762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dae74-6d5e-4a47-80d5-3b73b3ed3c2e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.694762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dae74-6d5e-4a47-80d5-3b73b3ed3c2e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.694762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dae74-6d5e-4a47-80d5-3b73b3ed3c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.747066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-273dae74-6d5e-4a47-80d5-3b73b3ed3c2e None None] MFA Rules not processed for user `dc004969e8344bbd8836829614500f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:02.749585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-273dae74-6d5e-4a47-80d5-3b73b3ed3c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:02.875214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1085/2143] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:02.879884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354db7f4-4d00-49d4-ba73-a1e41ff8cbb7 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.017841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c4d4-1672-46f2-8d4d-683fbf5c552e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.018862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c4d4-1672-46f2-8d4d-683fbf5c552e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.019347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c4d4-1672-46f2-8d4d-683fbf5c552e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.045588 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354db7f4-4d00-49d4-ba73-a1e41ff8cbb7 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.057519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965dc76-ad8f-4f4d-ac16-174c50265775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.058135 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965dc76-ad8f-4f4d-ac16-174c50265775 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.059960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965dc76-ad8f-4f4d-ac16-174c50265775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.059960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965dc76-ad8f-4f4d-ac16-174c50265775 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.059960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965dc76-ad8f-4f4d-ac16-174c50265775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.061852 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965dc76-ad8f-4f4d-ac16-174c50265775 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.089935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5388c4d4-1672-46f2-8d4d-683fbf5c552e None None] MFA Rules not processed for user `8ce7daea6fac45e79028cfd370bf0352`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:03.108211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5388c4d4-1672-46f2-8d4d-683fbf5c552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:03.239095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1086/2144] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:03.239212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1059/2145] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:02 2022] POST /identity/v3/projects => generated 383 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:03.248200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965dc76-ad8f-4f4d-ac16-174c50265775 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.248371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388c4d4-1672-46f2-8d4d-683fbf5c552e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.253978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5388c4d4-1672-46f2-8d4d-683fbf5c552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:03.287758 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388c4d4-1672-46f2-8d4d-683fbf5c552e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.357787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402249c-acc6-4602-9ba8-c820bbde2bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.358543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402249c-acc6-4602-9ba8-c820bbde2bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.358917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402249c-acc6-4602-9ba8-c820bbde2bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.359404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402249c-acc6-4602-9ba8-c820bbde2bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.359774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965dc76-ad8f-4f4d-ac16-174c50265775 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.360595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402249c-acc6-4602-9ba8-c820bbde2bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.362897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402249c-acc6-4602-9ba8-c820bbde2bb8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.364391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbd82d-3f4f-42e7-b755-22a2f7838fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.365030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbd82d-3f4f-42e7-b755-22a2f7838fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.365314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbd82d-3f4f-42e7-b755-22a2f7838fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.365594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbd82d-3f4f-42e7-b755-22a2f7838fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.366245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbd82d-3f4f-42e7-b755-22a2f7838fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.368644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbd82d-3f4f-42e7-b755-22a2f7838fc4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.506522 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1087/2146] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:03 2022] POST /identity/v3/projects => generated 371 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:03.508324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402249c-acc6-4602-9ba8-c820bbde2bb8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.516297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1060/2147] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:03 2022] POST /identity/v3/users => generated 298 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:03.517479 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbd82d-3f4f-42e7-b755-22a2f7838fc4 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.548586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbd82d-3f4f-42e7-b755-22a2f7838fc4 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.599583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402249c-acc6-4602-9ba8-c820bbde2bb8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.606355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ed4ed-0d0d-45f4-ac4c-631cf247002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.607005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ed4ed-0d0d-45f4-ac4c-631cf247002c admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.608394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ed4ed-0d0d-45f4-ac4c-631cf247002c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.609016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ed4ed-0d0d-45f4-ac4c-631cf247002c admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.610288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ed4ed-0d0d-45f4-ac4c-631cf247002c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.612606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ed4ed-0d0d-45f4-ac4c-631cf247002c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.645344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f60bc-5f60-43c4-abfe-f4f1195421c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.645954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f60bc-5f60-43c4-abfe-f4f1195421c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.646265 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f60bc-5f60-43c4-abfe-f4f1195421c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.646547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f60bc-5f60-43c4-abfe-f4f1195421c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.647201 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f60bc-5f60-43c4-abfe-f4f1195421c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.649296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f60bc-5f60-43c4-abfe-f4f1195421c1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.660035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1061/2148] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:03.665586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f60bc-5f60-43c4-abfe-f4f1195421c1 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.681162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f60bc-5f60-43c4-abfe-f4f1195421c1 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.690972 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba4e86-e06d-4557-9def-0535d9804d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.691954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba4e86-e06d-4557-9def-0535d9804d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.692422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba4e86-e06d-4557-9def-0535d9804d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.692778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba4e86-e06d-4557-9def-0535d9804d44 admin admin] PATH_INFO: `/v3/projects/ba12b6b077e74e6c98e012a7b6a996cc/users/7317e6110efb4328b068acecbdb9d129/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.715260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba4e86-e06d-4557-9def-0535d9804d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba12b6b077e74e6c98e012a7b6a996cc, user_id=7317e6110efb4328b068acecbdb9d129, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.719055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba4e86-e06d-4557-9def-0535d9804d44 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.784204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1088/2149] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:03 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:03.785087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ed4ed-0d0d-45f4-ac4c-631cf247002c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.796526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ed4ed-0d0d-45f4-ac4c-631cf247002c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.801917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b64609-597b-44f9-a22a-714e2a04fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.802932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b64609-597b-44f9-a22a-714e2a04fc66 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.803518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b64609-597b-44f9-a22a-714e2a04fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.803518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b64609-597b-44f9-a22a-714e2a04fc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.804291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b64609-597b-44f9-a22a-714e2a04fc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.806610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b64609-597b-44f9-a22a-714e2a04fc66 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.817963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1089/2150] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:03.822750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b64609-597b-44f9-a22a-714e2a04fc66 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.843557 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b64609-597b-44f9-a22a-714e2a04fc66 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.848243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a3906-31dd-4ebf-aac1-cd527618af75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.848905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a3906-31dd-4ebf-aac1-cd527618af75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.849215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a3906-31dd-4ebf-aac1-cd527618af75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.849492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a3906-31dd-4ebf-aac1-cd527618af75 admin admin] PATH_INFO: `/v3/projects/689f7ecb54684a42bf2517f1d7b63a8d/users/54eb762868f749c3874b5af1b1001d78/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.865452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a3906-31dd-4ebf-aac1-cd527618af75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689f7ecb54684a42bf2517f1d7b63a8d, user_id=54eb762868f749c3874b5af1b1001d78, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.868472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a3906-31dd-4ebf-aac1-cd527618af75 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.891464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1062/2151] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:03 2022] PUT /identity/v3/projects/ba12b6b077e74e6c98e012a7b6a996cc/users/7317e6110efb4328b068acecbdb9d129/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:03.896622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba4e86-e06d-4557-9def-0535d9804d44 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.984240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1090/2152] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:03 2022] PUT /identity/v3/projects/689f7ecb54684a42bf2517f1d7b63a8d/users/54eb762868f749c3874b5af1b1001d78/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:03.985384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a3906-31dd-4ebf-aac1-cd527618af75 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.003357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba4e86-e06d-4557-9def-0535d9804d44 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.065552 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23fd1a-f388-4ef1-b0f2-210604504c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.066303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23fd1a-f388-4ef1-b0f2-210604504c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.066486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23fd1a-f388-4ef1-b0f2-210604504c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.066759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23fd1a-f388-4ef1-b0f2-210604504c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.067435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23fd1a-f388-4ef1-b0f2-210604504c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.067928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a3906-31dd-4ebf-aac1-cd527618af75 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.069183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23fd1a-f388-4ef1-b0f2-210604504c18 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.074273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5cad2-2298-4e34-93c8-278d4430d261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.075107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5cad2-2298-4e34-93c8-278d4430d261 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.077438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5cad2-2298-4e34-93c8-278d4430d261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.077438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5cad2-2298-4e34-93c8-278d4430d261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.077438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5cad2-2298-4e34-93c8-278d4430d261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.078899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5cad2-2298-4e34-93c8-278d4430d261 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.079779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1063/2153] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:04.084171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23fd1a-f388-4ef1-b0f2-210604504c18 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.090234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1091/2154] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:04.094896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23fd1a-f388-4ef1-b0f2-210604504c18 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.103026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565360a-8472-42e8-9f5e-9dbe4b92ff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.103026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565360a-8472-42e8-9f5e-9dbe4b92ff0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.103026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565360a-8472-42e8-9f5e-9dbe4b92ff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.103026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565360a-8472-42e8-9f5e-9dbe4b92ff0d admin admin] PATH_INFO: `/v3/projects/ba12b6b077e74e6c98e012a7b6a996cc/users/7317e6110efb4328b068acecbdb9d129/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.105975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565360a-8472-42e8-9f5e-9dbe4b92ff0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba12b6b077e74e6c98e012a7b6a996cc, user_id=7317e6110efb4328b068acecbdb9d129, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.109037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565360a-8472-42e8-9f5e-9dbe4b92ff0d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.110179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5cad2-2298-4e34-93c8-278d4430d261 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.123308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1064/2155] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:04 2022] PUT /identity/v3/projects/ba12b6b077e74e6c98e012a7b6a996cc/users/7317e6110efb4328b068acecbdb9d129/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:04.125209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5cad2-2298-4e34-93c8-278d4430d261 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.140346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80187-7d3a-41df-8a4b-c2b8ee9a3073 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.140659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80187-7d3a-41df-8a4b-c2b8ee9a3073 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.140904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80187-7d3a-41df-8a4b-c2b8ee9a3073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.218359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91b252-3d79-4fba-83c0-a66da4d62c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.218985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b252-3d79-4fba-83c0-a66da4d62c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.219272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b252-3d79-4fba-83c0-a66da4d62c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.219556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b252-3d79-4fba-83c0-a66da4d62c14 admin admin] PATH_INFO: `/v3/projects/689f7ecb54684a42bf2517f1d7b63a8d/users/54eb762868f749c3874b5af1b1001d78/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.221538 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91b252-3d79-4fba-83c0-a66da4d62c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689f7ecb54684a42bf2517f1d7b63a8d, user_id=54eb762868f749c3874b5af1b1001d78, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.224425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91b252-3d79-4fba-83c0-a66da4d62c14 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.236749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1092/2156] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:04 2022] PUT /identity/v3/projects/689f7ecb54684a42bf2517f1d7b63a8d/users/54eb762868f749c3874b5af1b1001d78/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:04.246219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-06d80187-7d3a-41df-8a4b-c2b8ee9a3073 None None] MFA Rules not processed for user `7317e6110efb4328b068acecbdb9d129`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:04.247514 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-06d80187-7d3a-41df-8a4b-c2b8ee9a3073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:04.356520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1065/2157] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:04.369175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91b252-3d79-4fba-83c0-a66da4d62c14 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.371659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0c91b252-3d79-4fba-83c0-a66da4d62c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:04.458625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91b252-3d79-4fba-83c0-a66da4d62c14 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.463663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dbc34-738a-4939-bd40-b52a683a7f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.464233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dbc34-738a-4939-bd40-b52a683a7f69 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.464518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dbc34-738a-4939-bd40-b52a683a7f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.464792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dbc34-738a-4939-bd40-b52a683a7f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.474615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dbc34-738a-4939-bd40-b52a683a7f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.476317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dbc34-738a-4939-bd40-b52a683a7f69 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.488909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1093/2158] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:05.065609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:05.465327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:06.222476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d80187-7d3a-41df-8a4b-c2b8ee9a3073 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:06.332793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d80187-7d3a-41df-8a4b-c2b8ee9a3073 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:06.339019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:06.340152 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:06.340585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:06.341012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] PATH_INFO: `/v3/users/dc004969e8344bbd8836829614500f6f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:06.342736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc004969e8344bbd8836829614500f6f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:06.344726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:06.627906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc004969e8344bbd8836829614500f6f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.640807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc004969e8344bbd8836829614500f6f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.785283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc004969e8344bbd8836829614500f6f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.801810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc004969e8344bbd8836829614500f6f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.802604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc004969e8344bbd8836829614500f6f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.810118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1066/2159] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:06 2022] DELETE /identity/v3/users/dc004969e8344bbd8836829614500f6f => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:06.814907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dc3b4-3177-4d5b-b1ce-4b36f7f1bb97 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:06.815351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dc3b4-3177-4d5b-b1ce-4b36f7f1bb97 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:06.815453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dc3b4-3177-4d5b-b1ce-4b36f7f1bb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:06.852900 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3c7dc3b4-3177-4d5b-b1ce-4b36f7f1bb97 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:06.859370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3c7dc3b4-3177-4d5b-b1ce-4b36f7f1bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:06.985691 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1094/2160] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:07.014994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:07.017335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:07.152692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564e554-caff-49b7-96e7-149486f9b1b0 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:07.156779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f61000-d6d5-41bd-9aec-ddbd5722221b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:07.157392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f61000-d6d5-41bd-9aec-ddbd5722221b service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:07.157726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f61000-d6d5-41bd-9aec-ddbd5722221b service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:07.158005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f61000-d6d5-41bd-9aec-ddbd5722221b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:07.170229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f61000-d6d5-41bd-9aec-ddbd5722221b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:07.171926 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f61000-d6d5-41bd-9aec-ddbd5722221b service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:07.183879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1067/2161] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:07.489662 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:08.453265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dc3b4-3177-4d5b-b1ce-4b36f7f1bb97 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:08.456763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3c7dc3b4-3177-4d5b-b1ce-4b36f7f1bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:08.479788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dc3b4-3177-4d5b-b1ce-4b36f7f1bb97 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:08.488182 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:08.489138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:08.489640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:08.490232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] PATH_INFO: `/v3/projects/4a256e06a7ed45858761440d49b1a2a4` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:08.491830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a256e06a7ed45858761440d49b1a2a4)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:08.494803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:08.621788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a256e06a7ed45858761440d49b1a2a4', 'request_id': 'req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:08.642876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a256e06a7ed45858761440d49b1a2a4', 'request_id': 'req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:08.783652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a256e06a7ed45858761440d49b1a2a4', 'request_id': 'req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:08.801436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] The token cache is being invalidate because project 4a256e06a7ed45858761440d49b1a2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:08.801913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:08.802791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:08.806112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1095/2162] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:08 2022] DELETE /identity/v3/projects/4a256e06a7ed45858761440d49b1a2a4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:08.810008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f61000-d6d5-41bd-9aec-ddbd5722221b service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:08.823280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f61000-d6d5-41bd-9aec-ddbd5722221b service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:08.937356 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:08.938499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:08.938658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:08.939012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] PATH_INFO: `/v3/users/7317e6110efb4328b068acecbdb9d129` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:08.940570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7317e6110efb4328b068acecbdb9d129)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:08.943182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:09.088417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:09.185920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7317e6110efb4328b068acecbdb9d129'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:09.216254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7317e6110efb4328b068acecbdb9d129'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:09.322641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7317e6110efb4328b068acecbdb9d129'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:09.332246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7317e6110efb4328b068acecbdb9d129'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:09.334601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e364b6d4-6365-449f-9e91-db68d97e8d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7317e6110efb4328b068acecbdb9d129'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:09.344768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1068/2163] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:08 2022] DELETE /identity/v3/users/7317e6110efb4328b068acecbdb9d129 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:09.874694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:10.070793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:10.073202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:10.122544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe86d4-138e-4d9b-8786-d1c2976eb8ff admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:10.241855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:10.244606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:10.245053 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:10.245478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] PATH_INFO: `/v3/projects/ba12b6b077e74e6c98e012a7b6a996cc` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:10.247720 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba12b6b077e74e6c98e012a7b6a996cc)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:10.251042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:10.366154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba12b6b077e74e6c98e012a7b6a996cc', 'request_id': 'req-913f072a-b944-4fd0-90dc-0c4ebd20457a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:10.374981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba12b6b077e74e6c98e012a7b6a996cc', 'request_id': 'req-913f072a-b944-4fd0-90dc-0c4ebd20457a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:10.467667 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba12b6b077e74e6c98e012a7b6a996cc', 'request_id': 'req-913f072a-b944-4fd0-90dc-0c4ebd20457a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:10.507440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] The token cache is being invalidate because project ba12b6b077e74e6c98e012a7b6a996cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:10.507849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:10.510126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-913f072a-b944-4fd0-90dc-0c4ebd20457a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:10.513600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1096/2164] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:10 2022] DELETE /identity/v3/projects/ba12b6b077e74e6c98e012a7b6a996cc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:10.518939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24861a8c-0c11-404a-8b62-c72cdc719f12 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:10.519418 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24861a8c-0c11-404a-8b62-c72cdc719f12 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:10.519510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24861a8c-0c11-404a-8b62-c72cdc719f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:10.548316 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-24861a8c-0c11-404a-8b62-c72cdc719f12 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:10.549747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-24861a8c-0c11-404a-8b62-c72cdc719f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:10.632271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1069/2165] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:10.641028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f37d-f87a-48b8-814e-a0c99421b6f4 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:10.641419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f37d-f87a-48b8-814e-a0c99421b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:10.641762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f37d-f87a-48b8-814e-a0c99421b6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:10.674591 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3879f37d-f87a-48b8-814e-a0c99421b6f4 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:10.676528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3879f37d-f87a-48b8-814e-a0c99421b6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:10.691914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24861a8c-0c11-404a-8b62-c72cdc719f12 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:10.692611 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1097/2166] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:10.703759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24861a8c-0c11-404a-8b62-c72cdc719f12 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:10.713181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208181db-af3c-45fd-8739-4b5f31415938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:10.713181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208181db-af3c-45fd-8739-4b5f31415938 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:10.713181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208181db-af3c-45fd-8739-4b5f31415938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:10.713567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208181db-af3c-45fd-8739-4b5f31415938 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:10.713929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208181db-af3c-45fd-8739-4b5f31415938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:10.714262 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208181db-af3c-45fd-8739-4b5f31415938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:10.716200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208181db-af3c-45fd-8739-4b5f31415938 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:10.738930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1070/2167] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:10.743903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879f37d-f87a-48b8-814e-a0c99421b6f4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:10.753826 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879f37d-f87a-48b8-814e-a0c99421b6f4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:10.759998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38443dcd-449b-41bf-b31c-acce0e26daf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:10.760642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38443dcd-449b-41bf-b31c-acce0e26daf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:10.760924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38443dcd-449b-41bf-b31c-acce0e26daf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:10.761217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38443dcd-449b-41bf-b31c-acce0e26daf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:10.761839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38443dcd-449b-41bf-b31c-acce0e26daf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:10.763907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38443dcd-449b-41bf-b31c-acce0e26daf9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:10.879099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1098/2168] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:10 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:10.880414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208181db-af3c-45fd-8739-4b5f31415938 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:10.897449 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208181db-af3c-45fd-8739-4b5f31415938 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.067467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab23b1-287b-486f-80e1-ef2cc2376772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.068147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab23b1-287b-486f-80e1-ef2cc2376772 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.068492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab23b1-287b-486f-80e1-ef2cc2376772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.068810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab23b1-287b-486f-80e1-ef2cc2376772 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.069451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab23b1-287b-486f-80e1-ef2cc2376772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.074997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab23b1-287b-486f-80e1-ef2cc2376772 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.227579 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1071/2169] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:10 2022] POST /identity/v3/users => generated 286 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:11.230740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38443dcd-449b-41bf-b31c-acce0e26daf9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:11.252427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38443dcd-449b-41bf-b31c-acce0e26daf9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.265667 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e082b-e1fb-4d40-82f4-cb3ce8fa5316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.266470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e082b-e1fb-4d40-82f4-cb3ce8fa5316 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.266852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e082b-e1fb-4d40-82f4-cb3ce8fa5316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.267410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e082b-e1fb-4d40-82f4-cb3ce8fa5316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.268221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e082b-e1fb-4d40-82f4-cb3ce8fa5316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.275855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e082b-e1fb-4d40-82f4-cb3ce8fa5316 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.290957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1099/2170] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:11.294361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab23b1-287b-486f-80e1-ef2cc2376772 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:11.309871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab23b1-287b-486f-80e1-ef2cc2376772 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.329175 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e31308-5acf-47e8-85e0-bdedfacd7625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.329809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e31308-5acf-47e8-85e0-bdedfacd7625 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.330610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e31308-5acf-47e8-85e0-bdedfacd7625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.330610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e31308-5acf-47e8-85e0-bdedfacd7625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.331035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e31308-5acf-47e8-85e0-bdedfacd7625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.332726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e31308-5acf-47e8-85e0-bdedfacd7625 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.358298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1072/2171] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:11.359653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e082b-e1fb-4d40-82f4-cb3ce8fa5316 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:11.385760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e082b-e1fb-4d40-82f4-cb3ce8fa5316 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.386213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb5d4c-f401-4ca7-9929-c6796b95aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.387310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb5d4c-f401-4ca7-9929-c6796b95aaed admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.387763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb5d4c-f401-4ca7-9929-c6796b95aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.388203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb5d4c-f401-4ca7-9929-c6796b95aaed admin admin] PATH_INFO: `/v3/projects/6d9601337c7044cdabdb530a59cedc41/users/2f2d98b028674d7aa171ab5b6c16d149/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.407852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb5d4c-f401-4ca7-9929-c6796b95aaed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9601337c7044cdabdb530a59cedc41, user_id=2f2d98b028674d7aa171ab5b6c16d149, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.415071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb5d4c-f401-4ca7-9929-c6796b95aaed admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.487390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1100/2172] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:11 2022] PUT /identity/v3/projects/6d9601337c7044cdabdb530a59cedc41/users/2f2d98b028674d7aa171ab5b6c16d149/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:11.499001 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08817a-7a1e-409d-b02a-ed47780bc805 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.499114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08817a-7a1e-409d-b02a-ed47780bc805 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.499372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08817a-7a1e-409d-b02a-ed47780bc805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.563574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ff08817a-7a1e-409d-b02a-ed47780bc805 None None] MFA Rules not processed for user `2f2d98b028674d7aa171ab5b6c16d149`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:11.564975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ff08817a-7a1e-409d-b02a-ed47780bc805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:11.568586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:11.688448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1073/2173] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:11.700443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb5d4c-f401-4ca7-9929-c6796b95aaed admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:11.702265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c8eb5d4c-f401-4ca7-9929-c6796b95aaed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:11.791663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:11.792077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb5d4c-f401-4ca7-9929-c6796b95aaed admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.800419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc96df8-394a-498d-8078-627c96f5978c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.802862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc96df8-394a-498d-8078-627c96f5978c service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.803922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc96df8-394a-498d-8078-627c96f5978c service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.807701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc96df8-394a-498d-8078-627c96f5978c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.830638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc96df8-394a-498d-8078-627c96f5978c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.832435 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc96df8-394a-498d-8078-627c96f5978c service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.848898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1101/2174] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:11.877431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08817a-7a1e-409d-b02a-ed47780bc805 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:12.015655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08817a-7a1e-409d-b02a-ed47780bc805 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:12.021824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:12.022555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.022837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.023111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] PATH_INFO: `/v3/users/2f2d98b028674d7aa171ab5b6c16d149` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.028248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2d98b028674d7aa171ab5b6c16d149)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:12.028603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:12.341010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2d98b028674d7aa171ab5b6c16d149'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:12.365211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2d98b028674d7aa171ab5b6c16d149'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:12.453653 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2d98b028674d7aa171ab5b6c16d149'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:12.462584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2d98b028674d7aa171ab5b6c16d149'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:12.463424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2d98b028674d7aa171ab5b6c16d149'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:12.470689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1074/2175] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:11 2022] DELETE /identity/v3/users/2f2d98b028674d7aa171ab5b6c16d149 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:12.476146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc651b15-51b8-49f8-82af-c465071fd56e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.477521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc651b15-51b8-49f8-82af-c465071fd56e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.477806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc651b15-51b8-49f8-82af-c465071fd56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.522661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-dc651b15-51b8-49f8-82af-c465071fd56e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:12.524629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-dc651b15-51b8-49f8-82af-c465071fd56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:12.669523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1102/2176] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:12.682980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:12.684422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:12.750339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668899cb-3ebf-4667-b446-94fbec35338b admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:12.754796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ab577-4a9b-468d-87de-661000862c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:12.755811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ab577-4a9b-468d-87de-661000862c07 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.756252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ab577-4a9b-468d-87de-661000862c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.756699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ab577-4a9b-468d-87de-661000862c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.771975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ab577-4a9b-468d-87de-661000862c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:12.773000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ab577-4a9b-468d-87de-661000862c07 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:12.784961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1075/2177] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:49:12.843282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0499-76a3-4ee5-b623-88685098d816 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.843891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0499-76a3-4ee5-b623-88685098d816 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.845605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0499-76a3-4ee5-b623-88685098d816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.884786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e53b0499-76a3-4ee5-b623-88685098d816 None None] MFA Rules not processed for user `4489cb4f8ec144468b8308ba0a809539`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:12.886088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e53b0499-76a3-4ee5-b623-88685098d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:13.024399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1103/2178] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:13.553481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ab577-4a9b-468d-87de-661000862c07 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:13.554650 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cb7ab577-4a9b-468d-87de-661000862c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:13.578782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ab577-4a9b-468d-87de-661000862c07 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:13.588505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:13.588505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:13.588505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:13.588505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] PATH_INFO: `/v3/projects/6d9601337c7044cdabdb530a59cedc41` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:13.589854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9601337c7044cdabdb530a59cedc41)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:13.592750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:13.740033 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9601337c7044cdabdb530a59cedc41', 'request_id': 'req-5b36d25f-754a-4c48-adbf-436d67f97ca5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:13.893854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9601337c7044cdabdb530a59cedc41', 'request_id': 'req-5b36d25f-754a-4c48-adbf-436d67f97ca5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:13.902463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9601337c7044cdabdb530a59cedc41', 'request_id': 'req-5b36d25f-754a-4c48-adbf-436d67f97ca5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:13.914011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] The token cache is being invalidate because project 6d9601337c7044cdabdb530a59cedc41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:13.914798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:13.915682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-5b36d25f-754a-4c48-adbf-436d67f97ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:13.917343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1076/2179] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:13 2022] DELETE /identity/v3/projects/6d9601337c7044cdabdb530a59cedc41 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:13.922215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b46659-fabf-4b9f-b0c2-9a53877c7bac None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:13.922678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b46659-fabf-4b9f-b0c2-9a53877c7bac None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:13.923006 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b46659-fabf-4b9f-b0c2-9a53877c7bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:13.944384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f4b46659-fabf-4b9f-b0c2-9a53877c7bac None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:13.946258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f4b46659-fabf-4b9f-b0c2-9a53877c7bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:14.028904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1104/2180] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:14.037035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c307d5b-0d20-4179-b809-77686081a8ff None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:14.037332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c307d5b-0d20-4179-b809-77686081a8ff None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:14.037616 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c307d5b-0d20-4179-b809-77686081a8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:14.059794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7c307d5b-0d20-4179-b809-77686081a8ff None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:14.061259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7c307d5b-0d20-4179-b809-77686081a8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:14.069920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1077/2181] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:14.075140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b46659-fabf-4b9f-b0c2-9a53877c7bac None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:14.085466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b46659-fabf-4b9f-b0c2-9a53877c7bac None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:14.092437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e932fb7-c4bb-42a5-9958-ee1bee76d091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:14.093077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e932fb7-c4bb-42a5-9958-ee1bee76d091 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:14.093365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e932fb7-c4bb-42a5-9958-ee1bee76d091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:14.093646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e932fb7-c4bb-42a5-9958-ee1bee76d091 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:14.094086 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:14.094337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e932fb7-c4bb-42a5-9958-ee1bee76d091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:14.094654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e932fb7-c4bb-42a5-9958-ee1bee76d091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:14.096349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e932fb7-c4bb-42a5-9958-ee1bee76d091 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:14.112867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1105/2182] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:14.114058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c307d5b-0d20-4179-b809-77686081a8ff None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:14.124411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c307d5b-0d20-4179-b809-77686081a8ff None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:14.129156 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606cf9-b81c-4655-afe5-c279e8fadf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:14.130170 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606cf9-b81c-4655-afe5-c279e8fadf13 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:14.130496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606cf9-b81c-4655-afe5-c279e8fadf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:14.130896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606cf9-b81c-4655-afe5-c279e8fadf13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:14.131531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f606cf9-b81c-4655-afe5-c279e8fadf13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:14.134061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f606cf9-b81c-4655-afe5-c279e8fadf13 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:14.238965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1078/2183] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:14 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:14.244191 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e932fb7-c4bb-42a5-9958-ee1bee76d091 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:14.255351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e932fb7-c4bb-42a5-9958-ee1bee76d091 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:14.314223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4fca3-eb92-4f04-a92b-a23b0019f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:14.314932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4fca3-eb92-4f04-a92b-a23b0019f2bd admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:14.315212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4fca3-eb92-4f04-a92b-a23b0019f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:14.315484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4fca3-eb92-4f04-a92b-a23b0019f2bd admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:14.316295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4fca3-eb92-4f04-a92b-a23b0019f2bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:14.318296 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4fca3-eb92-4f04-a92b-a23b0019f2bd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:14.446957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1106/2184] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:14 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:14.453701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606cf9-b81c-4655-afe5-c279e8fadf13 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:14.480044 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606cf9-b81c-4655-afe5-c279e8fadf13 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:14.494477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc8036-38fb-487c-90da-6885446bc85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:14.495330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc8036-38fb-487c-90da-6885446bc85e admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:14.495705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc8036-38fb-487c-90da-6885446bc85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:14.496028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc8036-38fb-487c-90da-6885446bc85e admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:14.504529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc8036-38fb-487c-90da-6885446bc85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:14.504529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc8036-38fb-487c-90da-6885446bc85e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:14.519964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1079/2185] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:14.524036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4fca3-eb92-4f04-a92b-a23b0019f2bd admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:14.534648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4fca3-eb92-4f04-a92b-a23b0019f2bd admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:14.541292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edca7a1-dfe8-41d8-b5a8-cb297d7eef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:14.542023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edca7a1-dfe8-41d8-b5a8-cb297d7eef56 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:14.542415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edca7a1-dfe8-41d8-b5a8-cb297d7eef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:14.542755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edca7a1-dfe8-41d8-b5a8-cb297d7eef56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:14.543482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edca7a1-dfe8-41d8-b5a8-cb297d7eef56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:14.545185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edca7a1-dfe8-41d8-b5a8-cb297d7eef56 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:14.560270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1107/2186] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:14.561748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc8036-38fb-487c-90da-6885446bc85e admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:14.574040 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc8036-38fb-487c-90da-6885446bc85e admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:14.578842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b972a-7457-435e-9d56-33f6bfaffdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:14.579977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b972a-7457-435e-9d56-33f6bfaffdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:14.579977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b972a-7457-435e-9d56-33f6bfaffdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:14.584683 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b972a-7457-435e-9d56-33f6bfaffdc6 admin admin] PATH_INFO: `/v3/projects/9a081bf46bc348e48d79fde44ff27e02/users/089691488d4e4593a0efd941d7bcf17a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:14.595987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b972a-7457-435e-9d56-33f6bfaffdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a081bf46bc348e48d79fde44ff27e02, user_id=089691488d4e4593a0efd941d7bcf17a, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:14.598714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b972a-7457-435e-9d56-33f6bfaffdc6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:14.687973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1080/2187] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:14 2022] PUT /identity/v3/projects/9a081bf46bc348e48d79fde44ff27e02/users/089691488d4e4593a0efd941d7bcf17a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:14.695200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8af4ca-6709-4205-9b46-baf3ded9923c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:14.695667 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8af4ca-6709-4205-9b46-baf3ded9923c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:14.695828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8af4ca-6709-4205-9b46-baf3ded9923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:14.699619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11cea1-6055-4a27-ae85-2669c8754708 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:14.700127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11cea1-6055-4a27-ae85-2669c8754708 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:14.700592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11cea1-6055-4a27-ae85-2669c8754708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:14.741073 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0e8af4ca-6709-4205-9b46-baf3ded9923c None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:14.742308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7c11cea1-6055-4a27-ae85-2669c8754708 None None] MFA Rules not processed for user `089691488d4e4593a0efd941d7bcf17a`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:14.743331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0e8af4ca-6709-4205-9b46-baf3ded9923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:14.744659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7c11cea1-6055-4a27-ae85-2669c8754708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:14.864746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:14.877135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1108/2188] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:49:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:14.888235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1081/2189] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:14.902061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8af4ca-6709-4205-9b46-baf3ded9923c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:14.936686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11cea1-6055-4a27-ae85-2669c8754708 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:14.942765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7c11cea1-6055-4a27-ae85-2669c8754708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:15.091842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8af4ca-6709-4205-9b46-baf3ded9923c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:15.107065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1360a-bf47-4daa-a6a8-79a685136710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:15.107709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1360a-bf47-4daa-a6a8-79a685136710 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:15.107999 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1360a-bf47-4daa-a6a8-79a685136710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:15.108336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1360a-bf47-4daa-a6a8-79a685136710 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:15.108996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1360a-bf47-4daa-a6a8-79a685136710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:15.111142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1360a-bf47-4daa-a6a8-79a685136710 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:15.150411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11cea1-6055-4a27-ae85-2669c8754708 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:15.180781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8b667-dd1a-48f6-b5d2-62103d29f9ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:15.181900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8b667-dd1a-48f6-b5d2-62103d29f9ff service swift] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:15.182768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8b667-dd1a-48f6-b5d2-62103d29f9ff service swift] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:15.187237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8b667-dd1a-48f6-b5d2-62103d29f9ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:15.216082 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8b667-dd1a-48f6-b5d2-62103d29f9ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:15.217738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8b667-dd1a-48f6-b5d2-62103d29f9ff service swift] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:15.261867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1082/2190] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 12:49:15.261867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f0aa-e2ab-47dd-b635-d5d1d4dcfe96 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:15.261867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f0aa-e2ab-47dd-b635-d5d1d4dcfe96 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:15.261867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f0aa-e2ab-47dd-b635-d5d1d4dcfe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:15.264759 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1109/2191] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:14 2022] POST /identity/v3/projects => generated 373 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:15.268603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1360a-bf47-4daa-a6a8-79a685136710 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:15.376871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-3d97f0aa-e2ab-47dd-b635-d5d1d4dcfe96 None None] MFA Rules not processed for user `54eb762868f749c3874b5af1b1001d78`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:15.376871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3d97f0aa-e2ab-47dd-b635-d5d1d4dcfe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:15.460210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1360a-bf47-4daa-a6a8-79a685136710 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:15.476531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82c3a3-34f6-49dd-a36d-817e9752f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:15.476531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82c3a3-34f6-49dd-a36d-817e9752f6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:15.476531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82c3a3-34f6-49dd-a36d-817e9752f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:15.476531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82c3a3-34f6-49dd-a36d-817e9752f6e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:15.477576 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82c3a3-34f6-49dd-a36d-817e9752f6e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:15.478779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82c3a3-34f6-49dd-a36d-817e9752f6e8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:15.547761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1083/2192] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:15.564751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97f0aa-e2ab-47dd-b635-d5d1d4dcfe96 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:15.566964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3d97f0aa-e2ab-47dd-b635-d5d1d4dcfe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:15.596821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1110/2193] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:15 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:15.600487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82c3a3-34f6-49dd-a36d-817e9752f6e8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:15.626596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82c3a3-34f6-49dd-a36d-817e9752f6e8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:15.641271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833287b-89ea-45a1-9f7f-7ae0b5dd55b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:15.642089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833287b-89ea-45a1-9f7f-7ae0b5dd55b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:15.642406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833287b-89ea-45a1-9f7f-7ae0b5dd55b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:15.643825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833287b-89ea-45a1-9f7f-7ae0b5dd55b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:15.644685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833287b-89ea-45a1-9f7f-7ae0b5dd55b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:15.653996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833287b-89ea-45a1-9f7f-7ae0b5dd55b2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:15.707712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1111/2194] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:15.708462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833287b-89ea-45a1-9f7f-7ae0b5dd55b2 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:15.759935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833287b-89ea-45a1-9f7f-7ae0b5dd55b2 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:15.798018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069374ca-e37c-46c3-b00b-992c26e47d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:15.798481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069374ca-e37c-46c3-b00b-992c26e47d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:15.798717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069374ca-e37c-46c3-b00b-992c26e47d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:15.799008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069374ca-e37c-46c3-b00b-992c26e47d26 admin admin] PATH_INFO: `/v3/projects/f12a99b2a78141629068bc6f02f7e46d/users/11d8660f47824d69b8e11f3d7fac993f/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:15.804080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97f0aa-e2ab-47dd-b635-d5d1d4dcfe96 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:15.813446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1335ef5-752f-4c4c-821a-595f367a9997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:15.814286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1335ef5-752f-4c4c-821a-595f367a9997 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:15.814719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1335ef5-752f-4c4c-821a-595f367a9997 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:15.815211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1335ef5-752f-4c4c-821a-595f367a9997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:15.817524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a1335ef5-752f-4c4c-821a-595f367a9997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:15.849659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069374ca-e37c-46c3-b00b-992c26e47d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12a99b2a78141629068bc6f02f7e46d, user_id=11d8660f47824d69b8e11f3d7fac993f, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:15.859655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069374ca-e37c-46c3-b00b-992c26e47d26 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:15.970539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1112/2195] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:15 2022] PUT /identity/v3/projects/f12a99b2a78141629068bc6f02f7e46d/users/11d8660f47824d69b8e11f3d7fac993f/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:15.974849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069374ca-e37c-46c3-b00b-992c26e47d26 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:15.990817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1335ef5-752f-4c4c-821a-595f367a9997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:15.992500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1335ef5-752f-4c4c-821a-595f367a9997 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:16.036141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1084/2196] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:16.155601 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069374ca-e37c-46c3-b00b-992c26e47d26 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:16.168140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4199-5e6d-4932-8d88-30eb3e325b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:16.170438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4199-5e6d-4932-8d88-30eb3e325b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:16.170890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4199-5e6d-4932-8d88-30eb3e325b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:16.171496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4199-5e6d-4932-8d88-30eb3e325b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:16.172429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4199-5e6d-4932-8d88-30eb3e325b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:16.176133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4199-5e6d-4932-8d88-30eb3e325b68 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:16.215579 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1335ef5-752f-4c4c-821a-595f367a9997 service nova] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:16.227254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1113/2197] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:16.232374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1335ef5-752f-4c4c-821a-595f367a9997 service nova] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:16.246180 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4901c3a-62c3-42a3-aac8-035ccaa299d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:16.247762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4901c3a-62c3-42a3-aac8-035ccaa299d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:16.249551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4901c3a-62c3-42a3-aac8-035ccaa299d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:16.250020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4901c3a-62c3-42a3-aac8-035ccaa299d8 admin admin] PATH_INFO: `/v3/projects/f12a99b2a78141629068bc6f02f7e46d/users/11d8660f47824d69b8e11f3d7fac993f/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:16.254543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4901c3a-62c3-42a3-aac8-035ccaa299d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12a99b2a78141629068bc6f02f7e46d, user_id=11d8660f47824d69b8e11f3d7fac993f, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:16.268168 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4901c3a-62c3-42a3-aac8-035ccaa299d8 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:16.307042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd893df-4bdf-4dba-9b9c-8061c6063899 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:16.307595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd893df-4bdf-4dba-9b9c-8061c6063899 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:16.308112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd893df-4bdf-4dba-9b9c-8061c6063899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:16.315498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1085/2198] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:16 2022] PUT /identity/v3/projects/f12a99b2a78141629068bc6f02f7e46d/users/11d8660f47824d69b8e11f3d7fac993f/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:16.382454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2dd893df-4bdf-4dba-9b9c-8061c6063899 None None] MFA Rules not processed for user `11d8660f47824d69b8e11f3d7fac993f`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:16.385687 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2dd893df-4bdf-4dba-9b9c-8061c6063899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:16.586961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1114/2199] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:16.588292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4901c3a-62c3-42a3-aac8-035ccaa299d8 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:16.594093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e4901c3a-62c3-42a3-aac8-035ccaa299d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:16.678972 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4901c3a-62c3-42a3-aac8-035ccaa299d8 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:16.684124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8d52e-723b-4012-8f0c-b5af54a48931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:16.685823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8d52e-723b-4012-8f0c-b5af54a48931 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:16.685823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8d52e-723b-4012-8f0c-b5af54a48931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:16.685823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8d52e-723b-4012-8f0c-b5af54a48931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:16.780992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8d52e-723b-4012-8f0c-b5af54a48931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:16.783233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8d52e-723b-4012-8f0c-b5af54a48931 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:16.864234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1086/2200] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:17.516880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:18.831467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:19.049644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:20.903553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd893df-4bdf-4dba-9b9c-8061c6063899 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:20.941489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:21.098075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd893df-4bdf-4dba-9b9c-8061c6063899 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:21.112267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:21.112938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:21.115166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:21.115300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:21.115778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] PATH_INFO: `/v3/users/089691488d4e4593a0efd941d7bcf17a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:21.115778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089691488d4e4593a0efd941d7bcf17a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:21.124067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:21.515708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089691488d4e4593a0efd941d7bcf17a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:21.515708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089691488d4e4593a0efd941d7bcf17a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:21.521547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089691488d4e4593a0efd941d7bcf17a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:21.538840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089691488d4e4593a0efd941d7bcf17a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:21.608579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089691488d4e4593a0efd941d7bcf17a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:21.618739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1115/2201] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:20 2022] DELETE /identity/v3/users/089691488d4e4593a0efd941d7bcf17a => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:21.631411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088580-a2e7-41da-b5f1-2ac0ac5720f3 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:21.631411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088580-a2e7-41da-b5f1-2ac0ac5720f3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:21.631411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088580-a2e7-41da-b5f1-2ac0ac5720f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:21.671297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-fe088580-a2e7-41da-b5f1-2ac0ac5720f3 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:21.672984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-fe088580-a2e7-41da-b5f1-2ac0ac5720f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:21.827685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1087/2202] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:21.867792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:21.869394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:21.991842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd656c94-6d45-499a-bd04-0d2ebcdaf0d7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:22.000501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174304d0-d3c5-4edd-baf5-026342deaf1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:22.001452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174304d0-d3c5-4edd-baf5-026342deaf1f service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:22.001949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174304d0-d3c5-4edd-baf5-026342deaf1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:22.002228 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174304d0-d3c5-4edd-baf5-026342deaf1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:22.027643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174304d0-d3c5-4edd-baf5-026342deaf1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:22.031420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174304d0-d3c5-4edd-baf5-026342deaf1f service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:22.055475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1116/2203] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:49:22.540167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:22.727800 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049e4f-25e7-4368-9d26-7cb21065ed4f None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:22.728908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049e4f-25e7-4368-9d26-7cb21065ed4f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:22.729182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049e4f-25e7-4368-9d26-7cb21065ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:22.765098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-cc049e4f-25e7-4368-9d26-7cb21065ed4f None None] MFA Rules not processed for user `8ce7daea6fac45e79028cfd370bf0352`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:22.766466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cc049e4f-25e7-4368-9d26-7cb21065ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:22.833386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1088/2204] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:23.204684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:23.467978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174304d0-d3c5-4edd-baf5-026342deaf1f service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:23.469823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-174304d0-d3c5-4edd-baf5-026342deaf1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:23.495225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:23.511574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174304d0-d3c5-4edd-baf5-026342deaf1f service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:23.525246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:23.525912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:23.526219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:23.526496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] PATH_INFO: `/v3/projects/9a081bf46bc348e48d79fde44ff27e02` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:23.529430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a081bf46bc348e48d79fde44ff27e02)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:23.533277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:23.829804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a081bf46bc348e48d79fde44ff27e02', 'request_id': 'req-27a87abc-7d00-45f3-a64d-d2a7948a241d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:23.847180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a081bf46bc348e48d79fde44ff27e02', 'request_id': 'req-27a87abc-7d00-45f3-a64d-d2a7948a241d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.002706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a081bf46bc348e48d79fde44ff27e02', 'request_id': 'req-27a87abc-7d00-45f3-a64d-d2a7948a241d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.025901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] The token cache is being invalidate because project 9a081bf46bc348e48d79fde44ff27e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:24.027388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.028456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27a87abc-7d00-45f3-a64d-d2a7948a241d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.032265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1117/2205] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:23 2022] DELETE /identity/v3/projects/9a081bf46bc348e48d79fde44ff27e02 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:24.036128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049e4f-25e7-4368-9d26-7cb21065ed4f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:24.066308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049e4f-25e7-4368-9d26-7cb21065ed4f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:24.176219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:24.176895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:24.177778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:24.177778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] PATH_INFO: `/v3/users/11d8660f47824d69b8e11f3d7fac993f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:24.178763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d8660f47824d69b8e11f3d7fac993f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:24.181377 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:24.369543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:24.439703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d8660f47824d69b8e11f3d7fac993f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.487983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d8660f47824d69b8e11f3d7fac993f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.591144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d8660f47824d69b8e11f3d7fac993f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.601639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d8660f47824d69b8e11f3d7fac993f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.604181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d8660f47824d69b8e11f3d7fac993f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.624209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1089/2206] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:24 2022] DELETE /identity/v3/users/11d8660f47824d69b8e11f3d7fac993f => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:25.032175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbc42-4618-4ef0-baf8-8b5529ce4556 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:25.033075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbc42-4618-4ef0-baf8-8b5529ce4556 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:25.033356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbc42-4618-4ef0-baf8-8b5529ce4556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:25.058895 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a0ddbc42-4618-4ef0-baf8-8b5529ce4556 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:25.060300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a0ddbc42-4618-4ef0-baf8-8b5529ce4556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:25.143048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1118/2207] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:49:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:25.164886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:25.166801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:25.345512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987df409-feac-4327-ac40-c98391b79379 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:25.374496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fe73b-df67-42cf-9822-5aa0aa1ea43d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:25.375144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fe73b-df67-42cf-9822-5aa0aa1ea43d service swift] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:25.375429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fe73b-df67-42cf-9822-5aa0aa1ea43d service swift] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:25.375706 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fe73b-df67-42cf-9822-5aa0aa1ea43d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:25.387672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fe73b-df67-42cf-9822-5aa0aa1ea43d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:25.391474 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fe73b-df67-42cf-9822-5aa0aa1ea43d service swift] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:25.400330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1090/2208] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:49:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:49:25.574452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:25.605763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:25.619966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddbc42-4618-4ef0-baf8-8b5529ce4556 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:25.619966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a0ddbc42-4618-4ef0-baf8-8b5529ce4556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:25.772333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddbc42-4618-4ef0-baf8-8b5529ce4556 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:25.778989 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:25.779328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:25.779599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:25.779902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] PATH_INFO: `/v3/projects/f12a99b2a78141629068bc6f02f7e46d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:25.783709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12a99b2a78141629068bc6f02f7e46d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:25.786451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:26.103116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12a99b2a78141629068bc6f02f7e46d', 'request_id': 'req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:26.103116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12a99b2a78141629068bc6f02f7e46d', 'request_id': 'req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:26.712840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12a99b2a78141629068bc6f02f7e46d', 'request_id': 'req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:26.725343 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] The token cache is being invalidate because project f12a99b2a78141629068bc6f02f7e46d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:26.725937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:26.728031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3aa705f6-1c67-4d1f-82b7-dcea50d24a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:26.731129 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1119/2209] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:25 2022] DELETE /identity/v3/projects/f12a99b2a78141629068bc6f02f7e46d => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:26.736039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658211b6-c1e8-419e-8482-858d1f0c00dd None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:26.737662 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658211b6-c1e8-419e-8482-858d1f0c00dd None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:26.738212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658211b6-c1e8-419e-8482-858d1f0c00dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:26.803794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-658211b6-c1e8-419e-8482-858d1f0c00dd None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:26.808057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-658211b6-c1e8-419e-8482-858d1f0c00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:26.942316 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1091/2210] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:26.949728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edbfe1-32bf-41c9-9b24-35f8d27c3a97 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:26.955650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edbfe1-32bf-41c9-9b24-35f8d27c3a97 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:26.955650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edbfe1-32bf-41c9-9b24-35f8d27c3a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:27.014541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-43edbfe1-32bf-41c9-9b24-35f8d27c3a97 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:27.017451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-43edbfe1-32bf-41c9-9b24-35f8d27c3a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:27.040621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1120/2211] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:27.042140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658211b6-c1e8-419e-8482-858d1f0c00dd None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:27.060154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658211b6-c1e8-419e-8482-858d1f0c00dd None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:27.071636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de34826-13d3-44be-9af5-beebe22e082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:27.074588 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34826-13d3-44be-9af5-beebe22e082c admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:27.075039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34826-13d3-44be-9af5-beebe22e082c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:27.077271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34826-13d3-44be-9af5-beebe22e082c admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:27.078875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de34826-13d3-44be-9af5-beebe22e082c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:27.079594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de34826-13d3-44be-9af5-beebe22e082c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:27.093793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de34826-13d3-44be-9af5-beebe22e082c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:27.153444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1092/2212] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:27.158349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edbfe1-32bf-41c9-9b24-35f8d27c3a97 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:27.172060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edbfe1-32bf-41c9-9b24-35f8d27c3a97 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:27.184479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570e7a1-2a4d-47bb-9965-a170a08b61c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:27.185754 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e7a1-2a4d-47bb-9965-a170a08b61c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:27.186292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e7a1-2a4d-47bb-9965-a170a08b61c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:27.186881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e7a1-2a4d-47bb-9965-a170a08b61c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:27.187971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570e7a1-2a4d-47bb-9965-a170a08b61c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:27.195256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570e7a1-2a4d-47bb-9965-a170a08b61c0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:27.372571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1121/2213] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:27 2022] POST /identity/v3/projects => generated 367 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:27.377014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de34826-13d3-44be-9af5-beebe22e082c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:27.391975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de34826-13d3-44be-9af5-beebe22e082c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:27.586674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cac2f-5b28-4d76-8760-9e9fefbf6bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:27.587592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cac2f-5b28-4d76-8760-9e9fefbf6bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:27.587970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cac2f-5b28-4d76-8760-9e9fefbf6bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:27.588251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cac2f-5b28-4d76-8760-9e9fefbf6bcb admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:27.589107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cac2f-5b28-4d76-8760-9e9fefbf6bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:27.593735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cac2f-5b28-4d76-8760-9e9fefbf6bcb admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:27.782231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1093/2214] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:27 2022] POST /identity/v3/users => generated 284 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:27.786138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570e7a1-2a4d-47bb-9965-a170a08b61c0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:27.815622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570e7a1-2a4d-47bb-9965-a170a08b61c0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:27.838130 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3342aa-d2ae-47e1-ade1-64f60000ea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:27.838807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3342aa-d2ae-47e1-ade1-64f60000ea5b admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:27.839091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3342aa-d2ae-47e1-ade1-64f60000ea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:27.839362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3342aa-d2ae-47e1-ade1-64f60000ea5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:27.840017 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3342aa-d2ae-47e1-ade1-64f60000ea5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:27.841893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3342aa-d2ae-47e1-ade1-64f60000ea5b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:27.864149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1122/2215] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:27.869633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cac2f-5b28-4d76-8760-9e9fefbf6bcb admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:27.899705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cac2f-5b28-4d76-8760-9e9fefbf6bcb admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:27.919297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96abd4-fbf2-4fe5-a6aa-c4f547ab6bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:27.920036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96abd4-fbf2-4fe5-a6aa-c4f547ab6bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:27.921454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96abd4-fbf2-4fe5-a6aa-c4f547ab6bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:27.921454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96abd4-fbf2-4fe5-a6aa-c4f547ab6bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:27.921817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96abd4-fbf2-4fe5-a6aa-c4f547ab6bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:27.924134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96abd4-fbf2-4fe5-a6aa-c4f547ab6bb2 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:27.943112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1094/2216] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:27.949302 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3342aa-d2ae-47e1-ade1-64f60000ea5b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:27.968861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3342aa-d2ae-47e1-ade1-64f60000ea5b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:27.978911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f85441-9eb6-4855-9512-72f85067e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:27.980205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f85441-9eb6-4855-9512-72f85067e925 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:27.981005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f85441-9eb6-4855-9512-72f85067e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:27.981315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f85441-9eb6-4855-9512-72f85067e925 admin admin] PATH_INFO: `/v3/projects/308eeae7688d47158235b85e343c8945/users/a38ffebc85964d669d8a35096c91cc51/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:28.001750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f85441-9eb6-4855-9512-72f85067e925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308eeae7688d47158235b85e343c8945, user_id=a38ffebc85964d669d8a35096c91cc51, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:28.005179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f85441-9eb6-4855-9512-72f85067e925 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:28.140803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1123/2217] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:27 2022] PUT /identity/v3/projects/308eeae7688d47158235b85e343c8945/users/a38ffebc85964d669d8a35096c91cc51/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:28.156808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decddca-bb9e-471b-b066-514faa4e37c3 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:28.157095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decddca-bb9e-471b-b066-514faa4e37c3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:28.157451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decddca-bb9e-471b-b066-514faa4e37c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:28.294842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1decddca-bb9e-471b-b066-514faa4e37c3 None None] MFA Rules not processed for user `a38ffebc85964d669d8a35096c91cc51`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:28.296073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1decddca-bb9e-471b-b066-514faa4e37c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:28.408770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1095/2218] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:29.669487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:29.689238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:31.445525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:31.992028 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:32.315915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:33.201609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:33.392658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:34.057121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ed83c-40d6-4c09-a87f-3965dfb15a42 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:34.057417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ed83c-40d6-4c09-a87f-3965dfb15a42 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:34.057950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ed83c-40d6-4c09-a87f-3965dfb15a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:34.089643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2b1ed83c-40d6-4c09-a87f-3965dfb15a42 None None] MFA Rules not processed for user `23cfeac2a23e4f82a2d515db5c46ab6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:34.091434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2b1ed83c-40d6-4c09-a87f-3965dfb15a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:34.233295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1124/2219] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:34.859756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:35.027153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:35.762806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:36.116494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:36.220443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:36.986618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:37.238035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:37.940242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:38.031591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:38.803492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:39.717447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:40.174482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:40.254663 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:40.437284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:40.535029 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:40.764084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:41.354446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:41.501674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decddca-bb9e-471b-b066-514faa4e37c3 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:41.503261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1decddca-bb9e-471b-b066-514faa4e37c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:41.600623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decddca-bb9e-471b-b066-514faa4e37c3 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:41.604440 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c214e7-a086-4bfb-8264-4eed767ff417 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e56c9d900f4e4e91ea944d4cb0a40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:41.605100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c214e7-a086-4bfb-8264-4eed767ff417 service glance] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:41.605492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c214e7-a086-4bfb-8264-4eed767ff417 service glance] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:41.605774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c214e7-a086-4bfb-8264-4eed767ff417 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:41.628708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c214e7-a086-4bfb-8264-4eed767ff417 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:41.628708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c214e7-a086-4bfb-8264-4eed767ff417 service glance] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:41.628708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1096/2220] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:41.947921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1bc86-a0f3-4866-b3be-88245d535590 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:41.948512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1bc86-a0f3-4866-b3be-88245d535590 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:41.948512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1bc86-a0f3-4866-b3be-88245d535590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:41.983781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ded1bc86-a0f3-4866-b3be-88245d535590 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:42.001727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ded1bc86-a0f3-4866-b3be-88245d535590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:42.052263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:42.076649 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1125/2221] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:42.090734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c214e7-a086-4bfb-8264-4eed767ff417 service glance] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:42.092664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-62c214e7-a086-4bfb-8264-4eed767ff417 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:42.209575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c214e7-a086-4bfb-8264-4eed767ff417 service glance] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:42.216142 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828bada-6451-4582-b48f-21653527c7e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:42.216792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828bada-6451-4582-b48f-21653527c7e9 service swift] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:42.217856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828bada-6451-4582-b48f-21653527c7e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:42.219058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828bada-6451-4582-b48f-21653527c7e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:42.229954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828bada-6451-4582-b48f-21653527c7e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:42.234831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828bada-6451-4582-b48f-21653527c7e9 service swift] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:42.240443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1097/2222] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:49:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:49:42.777947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:42.838386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b49bc-0934-4867-9846-ed4541237697 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:42.838691 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b49bc-0934-4867-9846-ed4541237697 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:42.839004 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b49bc-0934-4867-9846-ed4541237697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:42.861972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-df0b49bc-0934-4867-9846-ed4541237697 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:42.863918 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-df0b49bc-0934-4867-9846-ed4541237697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:42.872143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1126/2223] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 22 12:49:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:42.886153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828bada-6451-4582-b48f-21653527c7e9 service swift] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:42.904663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828bada-6451-4582-b48f-21653527c7e9 service swift] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:42.911437 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d96ff5-b84e-414f-a049-659a77b9d489 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:42.912597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d96ff5-b84e-414f-a049-659a77b9d489 service swift] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:42.919372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d96ff5-b84e-414f-a049-659a77b9d489 service swift] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:42.919372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d96ff5-b84e-414f-a049-659a77b9d489 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:42.923850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d96ff5-b84e-414f-a049-659a77b9d489 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:42.925429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d96ff5-b84e-414f-a049-659a77b9d489 service swift] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:42.933927 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1098/2224] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:49:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:49:42.971094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:43.419953 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:43.522509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:43.877356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:43.917253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:44.064340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:44.128713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:44.265563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:44.435917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:44.808621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:46.579826 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b49bc-0934-4867-9846-ed4541237697 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:46.587251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-df0b49bc-0934-4867-9846-ed4541237697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:46.663010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b49bc-0934-4867-9846-ed4541237697 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:46.670134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:46.670823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:46.671212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:46.671437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] PATH_INFO: `/v3/users/3310bbca6df0438e9f6103a227713e13` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:46.672602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3310bbca6df0438e9f6103a227713e13)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:46.674588 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:46.924363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3310bbca6df0438e9f6103a227713e13'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:46.925102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3310bbca6df0438e9f6103a227713e13'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:46.947842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3310bbca6df0438e9f6103a227713e13'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:46.960701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3310bbca6df0438e9f6103a227713e13'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:46.963279 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:47.058626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e8c87ba6-65d6-40f8-abde-b23ff72d418a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3310bbca6df0438e9f6103a227713e13'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:47.065904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1127/2225] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:46 2022] DELETE /identity/v3/users/3310bbca6df0438e9f6103a227713e13 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:47.381213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d96ff5-b84e-414f-a049-659a77b9d489 service swift] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:47.390392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d96ff5-b84e-414f-a049-659a77b9d489 service swift] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:47.498374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:47.499276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:47.499725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:47.500240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] PATH_INFO: `/v3/projects/d9f73630a3b4449bbca7ae1f3e170295` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:47.502163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f73630a3b4449bbca7ae1f3e170295)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:47.504762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:47.631893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f73630a3b4449bbca7ae1f3e170295', 'request_id': 'req-ced5358a-1e25-43b1-8d08-c302050fe9ce'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:47.848110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f73630a3b4449bbca7ae1f3e170295', 'request_id': 'req-ced5358a-1e25-43b1-8d08-c302050fe9ce'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:47.855368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f73630a3b4449bbca7ae1f3e170295', 'request_id': 'req-ced5358a-1e25-43b1-8d08-c302050fe9ce'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:47.856556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:47.867336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] The token cache is being invalidate because project d9f73630a3b4449bbca7ae1f3e170295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:47.867542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:47.868200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-ced5358a-1e25-43b1-8d08-c302050fe9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:47.869733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1099/2226] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:47 2022] DELETE /identity/v3/projects/d9f73630a3b4449bbca7ae1f3e170295 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:47.874693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae385-ef66-4ef9-b9e2-0de167ed7f60 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:47.878596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae385-ef66-4ef9-b9e2-0de167ed7f60 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:47.878596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae385-ef66-4ef9-b9e2-0de167ed7f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:47.895253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-839ae385-ef66-4ef9-b9e2-0de167ed7f60 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:47.896823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-839ae385-ef66-4ef9-b9e2-0de167ed7f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:47.967128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1128/2227] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:47.974857 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30ba5d-2b49-4ef0-b3a0-963677572c7a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:47.975142 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30ba5d-2b49-4ef0-b3a0-963677572c7a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:47.975420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30ba5d-2b49-4ef0-b3a0-963677572c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:47.999436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-2c30ba5d-2b49-4ef0-b3a0-963677572c7a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:48.001016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2c30ba5d-2b49-4ef0-b3a0-963677572c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:48.042549 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1100/2228] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:48.042950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ae385-ef66-4ef9-b9e2-0de167ed7f60 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:48.042950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ae385-ef66-4ef9-b9e2-0de167ed7f60 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:48.047514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bd438-d982-4c43-889f-c85b440a4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:48.048228 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bd438-d982-4c43-889f-c85b440a4e81 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:48.048565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bd438-d982-4c43-889f-c85b440a4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:48.048850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bd438-d982-4c43-889f-c85b440a4e81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:48.049509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bd438-d982-4c43-889f-c85b440a4e81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:48.049820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bd438-d982-4c43-889f-c85b440a4e81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:48.051575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bd438-d982-4c43-889f-c85b440a4e81 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:48.064146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1129/2229] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:48.068511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30ba5d-2b49-4ef0-b3a0-963677572c7a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:48.082361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30ba5d-2b49-4ef0-b3a0-963677572c7a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:48.087750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea2b0-f111-47e0-bee5-8d5a6937d866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:48.088365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea2b0-f111-47e0-bee5-8d5a6937d866 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:48.088644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea2b0-f111-47e0-bee5-8d5a6937d866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:48.088918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea2b0-f111-47e0-bee5-8d5a6937d866 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:48.089550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ea2b0-f111-47e0-bee5-8d5a6937d866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:48.091629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ea2b0-f111-47e0-bee5-8d5a6937d866 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:48.245305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1101/2230] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:48 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:48.245630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80a33a-21d6-4597-9a5c-26fa5cda0fa8 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:48.246048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80a33a-21d6-4597-9a5c-26fa5cda0fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:48.246423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80a33a-21d6-4597-9a5c-26fa5cda0fa8 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:48.247832 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1130/2231] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:49:48.249076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea2b0-f111-47e0-bee5-8d5a6937d866 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:48.254945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915921b8-86ea-4d64-9dcb-8af71755ac82 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:48.255122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915921b8-86ea-4d64-9dcb-8af71755ac82 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:48.255415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915921b8-86ea-4d64-9dcb-8af71755ac82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:48.280477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-915921b8-86ea-4d64-9dcb-8af71755ac82 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:48.282021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-915921b8-86ea-4d64-9dcb-8af71755ac82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:48.357481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea2b0-f111-47e0-bee5-8d5a6937d866 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:48.363703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d37c1-62eb-4a3d-9cfc-01acd82fe95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:48.364475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d37c1-62eb-4a3d-9cfc-01acd82fe95f admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:48.364997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d37c1-62eb-4a3d-9cfc-01acd82fe95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:48.365397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d37c1-62eb-4a3d-9cfc-01acd82fe95f admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:48.366909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d37c1-62eb-4a3d-9cfc-01acd82fe95f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:48.369478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d37c1-62eb-4a3d-9cfc-01acd82fe95f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:48.413279 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1131/2232] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:49:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:48.529013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1102/2233] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:48 2022] POST /identity/v3/users => generated 283 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:48.532972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915921b8-86ea-4d64-9dcb-8af71755ac82 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:48.544286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915921b8-86ea-4d64-9dcb-8af71755ac82 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:48.549078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520302f-36c9-4b3c-9a57-28e443f007c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:48.549831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520302f-36c9-4b3c-9a57-28e443f007c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:48.550116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520302f-36c9-4b3c-9a57-28e443f007c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:48.550450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520302f-36c9-4b3c-9a57-28e443f007c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:48.551109 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520302f-36c9-4b3c-9a57-28e443f007c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:48.552776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520302f-36c9-4b3c-9a57-28e443f007c5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:48.569783 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1132/2234] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:48.574686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d37c1-62eb-4a3d-9cfc-01acd82fe95f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:48.585251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d37c1-62eb-4a3d-9cfc-01acd82fe95f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:48.590821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973d38-c91f-4f5c-a5b8-4f8b1765d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:48.591431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973d38-c91f-4f5c-a5b8-4f8b1765d3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:48.591758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973d38-c91f-4f5c-a5b8-4f8b1765d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:48.592042 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973d38-c91f-4f5c-a5b8-4f8b1765d3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:48.592690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973d38-c91f-4f5c-a5b8-4f8b1765d3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:48.594328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973d38-c91f-4f5c-a5b8-4f8b1765d3c4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:48.610224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1103/2235] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:48.613084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520302f-36c9-4b3c-9a57-28e443f007c5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:48.623647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520302f-36c9-4b3c-9a57-28e443f007c5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:48.628870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb1465-f354-4581-b273-5dafe2b94b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:48.630048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb1465-f354-4581-b273-5dafe2b94b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:48.630048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb1465-f354-4581-b273-5dafe2b94b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:48.635423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb1465-f354-4581-b273-5dafe2b94b42 admin admin] PATH_INFO: `/v3/projects/05082241facc4b75a4c73e3564542228/users/102e80d38b974bcb9847dbccfcdf93fc/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:48.648694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb1465-f354-4581-b273-5dafe2b94b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05082241facc4b75a4c73e3564542228, user_id=102e80d38b974bcb9847dbccfcdf93fc, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:48.651462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb1465-f354-4581-b273-5dafe2b94b42 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:48.773533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1133/2236] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:48 2022] PUT /identity/v3/projects/05082241facc4b75a4c73e3564542228/users/102e80d38b974bcb9847dbccfcdf93fc/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:48.784707 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5427ff-a182-4855-a73c-de17235f34a4 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:48.784993 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5427ff-a182-4855-a73c-de17235f34a4 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:48.785302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5427ff-a182-4855-a73c-de17235f34a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:48.813726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ab5427ff-a182-4855-a73c-de17235f34a4 None None] MFA Rules not processed for user `102e80d38b974bcb9847dbccfcdf93fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:48.814998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ab5427ff-a182-4855-a73c-de17235f34a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:48.892945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1104/2237] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:49:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:48.904380 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb1465-f354-4581-b273-5dafe2b94b42 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:48.906414 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5dcb1465-f354-4581-b273-5dafe2b94b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:48.949187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:48.967211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb1465-f354-4581-b273-5dafe2b94b42 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:48.970915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1804b-e81f-4969-9ac5-d5da146de0e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:48.971440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1804b-e81f-4969-9ac5-d5da146de0e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:48.971719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1804b-e81f-4969-9ac5-d5da146de0e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:48.971992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1804b-e81f-4969-9ac5-d5da146de0e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:48.980818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1804b-e81f-4969-9ac5-d5da146de0e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:48.982283 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1804b-e81f-4969-9ac5-d5da146de0e5 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:48.991927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1134/2238] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:58.115328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5427ff-a182-4855-a73c-de17235f34a4 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:58.116794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ab5427ff-a182-4855-a73c-de17235f34a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:58.156335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:58.181315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5427ff-a182-4855-a73c-de17235f34a4 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:58.185179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70494f3-b33d-42f2-832e-b729c9565301 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e56c9d900f4e4e91ea944d4cb0a40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:58.185832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70494f3-b33d-42f2-832e-b729c9565301 service glance] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:58.186207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70494f3-b33d-42f2-832e-b729c9565301 service glance] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:58.186500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70494f3-b33d-42f2-832e-b729c9565301 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:58.260629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70494f3-b33d-42f2-832e-b729c9565301 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:58.262067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70494f3-b33d-42f2-832e-b729c9565301 service glance] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:58.272693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1105/2239] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:58.318069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cd92f-7f1a-4013-a1ee-b53ce141c21c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:58.318704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cd92f-7f1a-4013-a1ee-b53ce141c21c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:58.318704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cd92f-7f1a-4013-a1ee-b53ce141c21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:58.338898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a54cd92f-7f1a-4013-a1ee-b53ce141c21c None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:58.340097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a54cd92f-7f1a-4013-a1ee-b53ce141c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:58.394889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1135/2240] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 22 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:58.407813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70494f3-b33d-42f2-832e-b729c9565301 service glance] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:58.409210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e70494f3-b33d-42f2-832e-b729c9565301 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:58.481468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70494f3-b33d-42f2-832e-b729c9565301 service glance] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:58.486760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479b5ba-63f3-452e-babc-07542115e646 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:58.487363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b5ba-63f3-452e-babc-07542115e646 service swift] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:58.487648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b5ba-63f3-452e-babc-07542115e646 service swift] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:58.487925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b5ba-63f3-452e-babc-07542115e646 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:58.496681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b5ba-63f3-452e-babc-07542115e646 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:58.498308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b5ba-63f3-452e-babc-07542115e646 service swift] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:58.506600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1106/2241] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:49:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:49:59.191227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179099-a70a-4ee2-adde-6f02e8c11576 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:59.191715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179099-a70a-4ee2-adde-6f02e8c11576 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:59.192167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179099-a70a-4ee2-adde-6f02e8c11576 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:59.196055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1136/2242] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:49:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:49:59.201666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3f261-2142-4cd1-9db5-81229439ee94 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:59.202160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3f261-2142-4cd1-9db5-81229439ee94 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:59.202307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3f261-2142-4cd1-9db5-81229439ee94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:59.224227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-86d3f261-2142-4cd1-9db5-81229439ee94 None None] MFA Rules not processed for user `948a5df1d4244c839a7faeb54f93dfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:59.225691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-86d3f261-2142-4cd1-9db5-81229439ee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:59.295972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa624962-d55e-49f0-b1f1-567d3ebcfa74 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:59.296549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa624962-d55e-49f0-b1f1-567d3ebcfa74 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:59.297063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa624962-d55e-49f0-b1f1-567d3ebcfa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:59.339149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1107/2243] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:59.355498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-aa624962-d55e-49f0-b1f1-567d3ebcfa74 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:59.357412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aa624962-d55e-49f0-b1f1-567d3ebcfa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:59.359335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3f261-2142-4cd1-9db5-81229439ee94 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:59.363499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-86d3f261-2142-4cd1-9db5-81229439ee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:59.387770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1137/2244] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:59.389562 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3f261-2142-4cd1-9db5-81229439ee94 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:59.393992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988ab57-258c-4379-861b-9df5addf4f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:59.395128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988ab57-258c-4379-861b-9df5addf4f30 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:59.395327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988ab57-258c-4379-861b-9df5addf4f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:59.395576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988ab57-258c-4379-861b-9df5addf4f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:59.401498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa624962-d55e-49f0-b1f1-567d3ebcfa74 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:59.404353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988ab57-258c-4379-861b-9df5addf4f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:59.406140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988ab57-258c-4379-861b-9df5addf4f30 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:59.411366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:59.417571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa624962-d55e-49f0-b1f1-567d3ebcfa74 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:59.428126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d548e-d0d7-494b-9814-2d12c07fbdc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:59.429035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d548e-d0d7-494b-9814-2d12c07fbdc6 service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:59.429304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1108/2245] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:59.429703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d548e-d0d7-494b-9814-2d12c07fbdc6 service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:59.430163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d548e-d0d7-494b-9814-2d12c07fbdc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:59.440934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d548e-d0d7-494b-9814-2d12c07fbdc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:59.443500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d548e-d0d7-494b-9814-2d12c07fbdc6 service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:59.455771 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1138/2246] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:49:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 12:49:59.521092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a951f76-7591-4c80-a239-9f76abf0cc0a None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:59.521433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a951f76-7591-4c80-a239-9f76abf0cc0a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:59.521710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a951f76-7591-4c80-a239-9f76abf0cc0a None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:59.523091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1109/2247] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:49:59.529644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64b52-cca3-463b-9628-c5dc1597d6f5 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:59.529934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64b52-cca3-463b-9628-c5dc1597d6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:59.530239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64b52-cca3-463b-9628-c5dc1597d6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:59.551803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5ed64b52-cca3-463b-9628-c5dc1597d6f5 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:59.553035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5ed64b52-cca3-463b-9628-c5dc1597d6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:59.563241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1139/2248] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:59.574409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a951f76-7591-4c80-a239-9f76abf0cc0a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:59.585642 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a951f76-7591-4c80-a239-9f76abf0cc0a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:59.589786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026134a6-ee25-41e3-8975-5ee24bc4ddd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:59.590419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026134a6-ee25-41e3-8975-5ee24bc4ddd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:59.590709 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026134a6-ee25-41e3-8975-5ee24bc4ddd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:59.590985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026134a6-ee25-41e3-8975-5ee24bc4ddd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:59.601526 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026134a6-ee25-41e3-8975-5ee24bc4ddd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:59.603759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026134a6-ee25-41e3-8975-5ee24bc4ddd7 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:59.615652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1110/2249] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:50:00.175465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4592-dc80-46f9-824e-1c772cc7ca29 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:00.175767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4592-dc80-46f9-824e-1c772cc7ca29 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:00.176107 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4592-dc80-46f9-824e-1c772cc7ca29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:00.195891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-facb4592-dc80-46f9-824e-1c772cc7ca29 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:00.197401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-facb4592-dc80-46f9-824e-1c772cc7ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:00.204865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1140/2250] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 22 12:50:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:50:00.218541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026134a6-ee25-41e3-8975-5ee24bc4ddd7 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:00.231010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026134a6-ee25-41e3-8975-5ee24bc4ddd7 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:00.236176 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d12319-9fbe-4bd0-96a4-c9adddb73299 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:00.236769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d12319-9fbe-4bd0-96a4-c9adddb73299 service swift] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:00.237049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d12319-9fbe-4bd0-96a4-c9adddb73299 service swift] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:00.241070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d12319-9fbe-4bd0-96a4-c9adddb73299 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:00.246221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d12319-9fbe-4bd0-96a4-c9adddb73299 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:00.247796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d12319-9fbe-4bd0-96a4-c9adddb73299 service swift] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:00.256699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1111/2251] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:50:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 12:50:03.547519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb4592-dc80-46f9-824e-1c772cc7ca29 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:03.549200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-facb4592-dc80-46f9-824e-1c772cc7ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:03.637236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb4592-dc80-46f9-824e-1c772cc7ca29 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:03.648883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:03.650092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:03.650407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:03.650688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] PATH_INFO: `/v3/users/33f0771372bf4d90a5798c97aae10002` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:03.651839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f0771372bf4d90a5798c97aae10002)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:03.653839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:03.908434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f0771372bf4d90a5798c97aae10002'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:03.909164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f0771372bf4d90a5798c97aae10002'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:03.915691 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:03.918647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f0771372bf4d90a5798c97aae10002'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:03.932633 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f0771372bf4d90a5798c97aae10002'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:04.030767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a2a082b3-58c4-43a9-a006-ca509a223455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f0771372bf4d90a5798c97aae10002'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:04.037799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1141/2252] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:50:03 2022] DELETE /identity/v3/users/33f0771372bf4d90a5798c97aae10002 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:04.042112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46333a00-64c9-48e1-872a-42fa604758a8 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:04.042602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46333a00-64c9-48e1-872a-42fa604758a8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:04.042712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46333a00-64c9-48e1-872a-42fa604758a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:04.062595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-46333a00-64c9-48e1-872a-42fa604758a8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:04.063890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-46333a00-64c9-48e1-872a-42fa604758a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:04.148310 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1112/2253] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:50:04.172753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435447fd-4017-4790-8697-89177dc73759 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:04.173061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435447fd-4017-4790-8697-89177dc73759 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:04.173332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435447fd-4017-4790-8697-89177dc73759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:04.187172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46333a00-64c9-48e1-872a-42fa604758a8 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:04.189746 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-46333a00-64c9-48e1-872a-42fa604758a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:04.197043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-435447fd-4017-4790-8697-89177dc73759 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:04.198412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-435447fd-4017-4790-8697-89177dc73759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:04.277035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1142/2254] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:50:04.278977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46333a00-64c9-48e1-872a-42fa604758a8 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:04.283320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fce2a-0fad-488a-bca9-3785168d57a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:04.284016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fce2a-0fad-488a-bca9-3785168d57a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:04.284391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fce2a-0fad-488a-bca9-3785168d57a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:04.285075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fce2a-0fad-488a-bca9-3785168d57a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:04.293481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435447fd-4017-4790-8697-89177dc73759 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:04.293481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-435447fd-4017-4790-8697-89177dc73759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:04.295938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fce2a-0fad-488a-bca9-3785168d57a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:04.297779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fce2a-0fad-488a-bca9-3785168d57a1 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:04.308737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1113/2255] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:50:04.375822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435447fd-4017-4790-8697-89177dc73759 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:04.381419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea042d-9cf1-4fb8-98d0-bebcda59650f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:04.382030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea042d-9cf1-4fb8-98d0-bebcda59650f service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:04.382345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea042d-9cf1-4fb8-98d0-bebcda59650f service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:04.382619 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea042d-9cf1-4fb8-98d0-bebcda59650f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:04.392104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea042d-9cf1-4fb8-98d0-bebcda59650f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:04.395144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea042d-9cf1-4fb8-98d0-bebcda59650f service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:04.408720 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1143/2256] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:50:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:50:04.628022 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fce2a-0fad-488a-bca9-3785168d57a1 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:04.629506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0b1fce2a-0fad-488a-bca9-3785168d57a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:04.656608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fce2a-0fad-488a-bca9-3785168d57a1 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:04.670888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:04.671570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:04.671908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:04.672119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] PATH_INFO: `/v3/projects/ae4da7e5e9a540b29c115c3520736f47` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:04.673753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4da7e5e9a540b29c115c3520736f47)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:04.675789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:04.829924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4da7e5e9a540b29c115c3520736f47', 'request_id': 'req-d57f4af0-7451-4b85-933d-6b60664bf03f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:04.911088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4da7e5e9a540b29c115c3520736f47', 'request_id': 'req-d57f4af0-7451-4b85-933d-6b60664bf03f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:04.918581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4da7e5e9a540b29c115c3520736f47', 'request_id': 'req-d57f4af0-7451-4b85-933d-6b60664bf03f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:04.927757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:04.933094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] The token cache is being invalidate because project ae4da7e5e9a540b29c115c3520736f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:50:04.933574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:04.934139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d57f4af0-7451-4b85-933d-6b60664bf03f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:04.936031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1114/2257] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:50:04 2022] DELETE /identity/v3/projects/ae4da7e5e9a540b29c115c3520736f47 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:14.403389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=67,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:22.649657 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea042d-9cf1-4fb8-98d0-bebcda59650f service swift] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:22.651607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-efea042d-9cf1-4fb8-98d0-bebcda59650f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:22.666094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea042d-9cf1-4fb8-98d0-bebcda59650f service swift] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:22.725349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:22.726005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:22.726329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:22.726824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] PATH_INFO: `/v3/users/a38ffebc85964d669d8a35096c91cc51` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:22.727999 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a38ffebc85964d669d8a35096c91cc51)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:22.731715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:22.914718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a38ffebc85964d669d8a35096c91cc51'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:22.915555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a38ffebc85964d669d8a35096c91cc51'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:22.923826 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a38ffebc85964d669d8a35096c91cc51'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:22.950849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a38ffebc85964d669d8a35096c91cc51'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:23.025403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a38ffebc85964d669d8a35096c91cc51'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:23.032960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1144/2258] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:50:22 2022] DELETE /identity/v3/users/a38ffebc85964d669d8a35096c91cc51 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:50:23.037379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98561c16-43aa-4e0a-82f2-47de29c28170 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:23.037929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98561c16-43aa-4e0a-82f2-47de29c28170 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:23.038146 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98561c16-43aa-4e0a-82f2-47de29c28170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:23.059688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-98561c16-43aa-4e0a-82f2-47de29c28170 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:23.061117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-98561c16-43aa-4e0a-82f2-47de29c28170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:23.154055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1115/2259] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:50:23.173375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:23.175945 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:23.268755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16ff8-2ba5-4bee-a926-02b706f80211 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:23.272577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50cb5a-2365-4977-8844-1cdd33470238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:23.276058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50cb5a-2365-4977-8844-1cdd33470238 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:23.276058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50cb5a-2365-4977-8844-1cdd33470238 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:23.276058 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50cb5a-2365-4977-8844-1cdd33470238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:23.285209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50cb5a-2365-4977-8844-1cdd33470238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:23.293686 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50cb5a-2365-4977-8844-1cdd33470238 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:23.308968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1145/2260] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:50:23.982407 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98561c16-43aa-4e0a-82f2-47de29c28170 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:23.984130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-98561c16-43aa-4e0a-82f2-47de29c28170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:23.998307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98561c16-43aa-4e0a-82f2-47de29c28170 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:24.004936 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:24.011483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:24.011483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:24.011483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] PATH_INFO: `/v3/projects/308eeae7688d47158235b85e343c8945` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:24.011483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=308eeae7688d47158235b85e343c8945)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:24.011483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:24.141116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308eeae7688d47158235b85e343c8945', 'request_id': 'req-91263e1a-7ee2-4da7-ba42-8bede53b4310'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:24.232546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308eeae7688d47158235b85e343c8945', 'request_id': 'req-91263e1a-7ee2-4da7-ba42-8bede53b4310'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:24.250292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308eeae7688d47158235b85e343c8945', 'request_id': 'req-91263e1a-7ee2-4da7-ba42-8bede53b4310'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:24.273274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acd159-89c9-481f-9fae-41a99ffc5dc2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:24.273848 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acd159-89c9-481f-9fae-41a99ffc5dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:24.273848 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acd159-89c9-481f-9fae-41a99ffc5dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:24.279865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] The token cache is being invalidate because project 308eeae7688d47158235b85e343c8945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:50:24.280763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:24.294853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:24.300722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1116/2261] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:50:23 2022] DELETE /identity/v3/projects/308eeae7688d47158235b85e343c8945 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:24.307693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d6acd159-89c9-481f-9fae-41a99ffc5dc2 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:24.308412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d6acd159-89c9-481f-9fae-41a99ffc5dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:24.336951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:24.438135 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1146/2262] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 22 12:50:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:50:24.467059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:24.469088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:24.559125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91263e1a-7ee2-4da7-ba42-8bede53b4310 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:24.567506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2210bc-55d4-49b4-9176-6611d33dcde8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:24.568119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2210bc-55d4-49b4-9176-6611d33dcde8 service swift] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:24.568398 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2210bc-55d4-49b4-9176-6611d33dcde8 service swift] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:24.568669 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2210bc-55d4-49b4-9176-6611d33dcde8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:24.577670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2210bc-55d4-49b4-9176-6611d33dcde8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:24.579280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2210bc-55d4-49b4-9176-6611d33dcde8 service swift] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:24.587826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1117/2263] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:50:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:50:29.883185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acd159-89c9-481f-9fae-41a99ffc5dc2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:29.885337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d6acd159-89c9-481f-9fae-41a99ffc5dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:29.982615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acd159-89c9-481f-9fae-41a99ffc5dc2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:29.997422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c77a38-be59-4053-8595-c9ba22d22edf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8495c97df48f18b10039584d52f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:29.998148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c77a38-be59-4053-8595-c9ba22d22edf service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:29.998527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c77a38-be59-4053-8595-c9ba22d22edf service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:29.998805 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c77a38-be59-4053-8595-c9ba22d22edf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:30.001966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-02c77a38-be59-4053-8595-c9ba22d22edf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:30.016063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c77a38-be59-4053-8595-c9ba22d22edf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:30.017917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c77a38-be59-4053-8595-c9ba22d22edf service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:30.042827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1147/2264] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:50:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:50:30.405126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2210bc-55d4-49b4-9176-6611d33dcde8 service swift] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:30.406660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-fa2210bc-55d4-49b4-9176-6611d33dcde8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:30.424127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:30.479841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2210bc-55d4-49b4-9176-6611d33dcde8 service swift] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:30.485540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:30.486121 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:30.486569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:30.486829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] PATH_INFO: `/v3/users/102e80d38b974bcb9847dbccfcdf93fc` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:30.488411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=102e80d38b974bcb9847dbccfcdf93fc)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:30.490383 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:30.753847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102e80d38b974bcb9847dbccfcdf93fc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:30.765068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102e80d38b974bcb9847dbccfcdf93fc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:30.899708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102e80d38b974bcb9847dbccfcdf93fc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:30.908343 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102e80d38b974bcb9847dbccfcdf93fc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:30.908981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102e80d38b974bcb9847dbccfcdf93fc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:30.925482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1118/2265] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:50:30 2022] DELETE /identity/v3/users/102e80d38b974bcb9847dbccfcdf93fc => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:30.928420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1db58-4452-4701-9fb8-9257a28f6134 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:30.928879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1db58-4452-4701-9fb8-9257a28f6134 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:30.929002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1db58-4452-4701-9fb8-9257a28f6134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:30.967627 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-42e1db58-4452-4701-9fb8-9257a28f6134 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:30.968901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-42e1db58-4452-4701-9fb8-9257a28f6134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:31.113604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1148/2266] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:50:31.124143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:31.125796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:31.206089 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eefae9-e7e2-436a-b060-b0e2b76caa6d admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:31.216287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3058bc6-dc62-4d1b-aa9b-179dfa51c30d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:31.216954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3058bc6-dc62-4d1b-aa9b-179dfa51c30d service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:31.217235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3058bc6-dc62-4d1b-aa9b-179dfa51c30d service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:31.217581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3058bc6-dc62-4d1b-aa9b-179dfa51c30d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:31.233615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3058bc6-dc62-4d1b-aa9b-179dfa51c30d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:31.235085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3058bc6-dc62-4d1b-aa9b-179dfa51c30d service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:31.276766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1119/2267] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:50:31.802927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1db58-4452-4701-9fb8-9257a28f6134 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:31.804384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-42e1db58-4452-4701-9fb8-9257a28f6134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:31.824574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1db58-4452-4701-9fb8-9257a28f6134 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:31.832935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:31.833599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:31.833881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:31.834214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] PATH_INFO: `/v3/projects/05082241facc4b75a4c73e3564542228` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:31.835354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=05082241facc4b75a4c73e3564542228)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:31.837530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:31.963489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05082241facc4b75a4c73e3564542228', 'request_id': 'req-807281a9-699d-4803-9ab8-a21dfdc31dbe'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:31.966584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:31.970683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05082241facc4b75a4c73e3564542228', 'request_id': 'req-807281a9-699d-4803-9ab8-a21dfdc31dbe'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:32.057665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05082241facc4b75a4c73e3564542228', 'request_id': 'req-807281a9-699d-4803-9ab8-a21dfdc31dbe'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:32.068973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] The token cache is being invalidate because project 05082241facc4b75a4c73e3564542228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:50:32.069293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:32.069950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-807281a9-699d-4803-9ab8-a21dfdc31dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:32.071419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1149/2268] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:50:31 2022] DELETE /identity/v3/projects/05082241facc4b75a4c73e3564542228 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:32.076943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f88cb-827c-478b-881f-9f5bd2fc56f7 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:32.077400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f88cb-827c-478b-881f-9f5bd2fc56f7 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:32.077519 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f88cb-827c-478b-881f-9f5bd2fc56f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:32.101772 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-733f88cb-827c-478b-881f-9f5bd2fc56f7 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:32.101772 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-733f88cb-827c-478b-881f-9f5bd2fc56f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:32.129836 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:32.161372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1120/2269] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:50:32.166684 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e15e4f-bab0-47cb-bd04-e63b335fbaef None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:32.166980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e15e4f-bab0-47cb-bd04-e63b335fbaef None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:32.167264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e15e4f-bab0-47cb-bd04-e63b335fbaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:32.207842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-91e15e4f-bab0-47cb-bd04-e63b335fbaef None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:32.209290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-91e15e4f-bab0-47cb-bd04-e63b335fbaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:32.219775 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1150/2270] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:50:32.224750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f88cb-827c-478b-881f-9f5bd2fc56f7 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:32.234884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f88cb-827c-478b-881f-9f5bd2fc56f7 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:32.240503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52fff9-29bf-4a86-9bd2-243b7b32b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:32.241203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52fff9-29bf-4a86-9bd2-243b7b32b910 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:32.241547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52fff9-29bf-4a86-9bd2-243b7b32b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:32.242460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52fff9-29bf-4a86-9bd2-243b7b32b910 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:32.243419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52fff9-29bf-4a86-9bd2-243b7b32b910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:50:32.243855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52fff9-29bf-4a86-9bd2-243b7b32b910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:32.245549 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52fff9-29bf-4a86-9bd2-243b7b32b910 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:32.259060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1121/2271] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:50:32.263953 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e15e4f-bab0-47cb-bd04-e63b335fbaef None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:32.275296 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e15e4f-bab0-47cb-bd04-e63b335fbaef None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:32.282044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ddb35-e1cd-4c95-89c1-783d8a01452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:32.282745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ddb35-e1cd-4c95-89c1-783d8a01452d admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:32.283010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ddb35-e1cd-4c95-89c1-783d8a01452d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:32.283258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ddb35-e1cd-4c95-89c1-783d8a01452d admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:32.283894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ddb35-e1cd-4c95-89c1-783d8a01452d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:32.285818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ddb35-e1cd-4c95-89c1-783d8a01452d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:32.415728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1151/2272] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:50:32 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:50:32.420025 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52fff9-29bf-4a86-9bd2-243b7b32b910 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:32.430027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52fff9-29bf-4a86-9bd2-243b7b32b910 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:32.493162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867aa1c-6ade-45b4-a943-50a5d06c0b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:32.493804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867aa1c-6ade-45b4-a943-50a5d06c0b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:32.494174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867aa1c-6ade-45b4-a943-50a5d06c0b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:32.494478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867aa1c-6ade-45b4-a943-50a5d06c0b03 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:32.495110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867aa1c-6ade-45b4-a943-50a5d06c0b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:32.497606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867aa1c-6ade-45b4-a943-50a5d06c0b03 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:32.586339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1122/2273] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:50:32 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:50:32.590977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ddb35-e1cd-4c95-89c1-783d8a01452d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:32.608095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ddb35-e1cd-4c95-89c1-783d8a01452d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:32.613881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3d4d-3149-48c5-9ce4-34c743f5ca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:32.621125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3d4d-3149-48c5-9ce4-34c743f5ca90 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:32.621125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3d4d-3149-48c5-9ce4-34c743f5ca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:32.621125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3d4d-3149-48c5-9ce4-34c743f5ca90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:32.621125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d3d4d-3149-48c5-9ce4-34c743f5ca90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:32.621125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d3d4d-3149-48c5-9ce4-34c743f5ca90 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:32.632703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1152/2274] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:50:32.635396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867aa1c-6ade-45b4-a943-50a5d06c0b03 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:32.647273 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867aa1c-6ade-45b4-a943-50a5d06c0b03 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:32.652120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910a875-f8f1-489d-aa99-d17dd8518191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:32.652770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910a875-f8f1-489d-aa99-d17dd8518191 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:32.661274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910a875-f8f1-489d-aa99-d17dd8518191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:32.661274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910a875-f8f1-489d-aa99-d17dd8518191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:32.661274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910a875-f8f1-489d-aa99-d17dd8518191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:32.661274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910a875-f8f1-489d-aa99-d17dd8518191 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:32.668088 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1123/2275] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:50:32.672088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3d4d-3149-48c5-9ce4-34c743f5ca90 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:32.687467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3d4d-3149-48c5-9ce4-34c743f5ca90 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:32.692940 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeb61c-37b3-482f-b381-1790957b3c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:32.693873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeb61c-37b3-482f-b381-1790957b3c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:32.694161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeb61c-37b3-482f-b381-1790957b3c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:32.694484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeb61c-37b3-482f-b381-1790957b3c5f admin admin] PATH_INFO: `/v3/projects/1ac930d4d3a24e0aad18077aa0275fde/users/43a1e3f35d264036ba475937e48a9588/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:32.711504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeb61c-37b3-482f-b381-1790957b3c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac930d4d3a24e0aad18077aa0275fde, user_id=43a1e3f35d264036ba475937e48a9588, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:32.714291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeb61c-37b3-482f-b381-1790957b3c5f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:32.814565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1153/2276] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:50:32 2022] PUT /identity/v3/projects/1ac930d4d3a24e0aad18077aa0275fde/users/43a1e3f35d264036ba475937e48a9588/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:32.825895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11473e0f-b605-4a0c-8482-7aecda1e2d27 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:32.826236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11473e0f-b605-4a0c-8482-7aecda1e2d27 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:32.826522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11473e0f-b605-4a0c-8482-7aecda1e2d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:32.854950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-11473e0f-b605-4a0c-8482-7aecda1e2d27 None None] MFA Rules not processed for user `43a1e3f35d264036ba475937e48a9588`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:32.856842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-11473e0f-b605-4a0c-8482-7aecda1e2d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:32.921727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1124/2277] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:50:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:50:32.932670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeb61c-37b3-482f-b381-1790957b3c5f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:32.934898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4edeb61c-37b3-482f-b381-1790957b3c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:33.000517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeb61c-37b3-482f-b381-1790957b3c5f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:33.004379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e3cd-cdc7-4d55-b6eb-bf49f4edda03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:33.004998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e3cd-cdc7-4d55-b6eb-bf49f4edda03 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:33.005282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e3cd-cdc7-4d55-b6eb-bf49f4edda03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:33.005672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e3cd-cdc7-4d55-b6eb-bf49f4edda03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:33.015436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2e3cd-cdc7-4d55-b6eb-bf49f4edda03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:33.016895 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2e3cd-cdc7-4d55-b6eb-bf49f4edda03 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:33.026308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1154/2278] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:50:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:50:35.233776 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11473e0f-b605-4a0c-8482-7aecda1e2d27 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:35.235205 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-11473e0f-b605-4a0c-8482-7aecda1e2d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:35.274409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:35.297730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11473e0f-b605-4a0c-8482-7aecda1e2d27 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:35.301305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91459e-86cb-4e28-b48a-21929d46b490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:35.301908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91459e-86cb-4e28-b48a-21929d46b490 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:35.302200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91459e-86cb-4e28-b48a-21929d46b490 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:35.302494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91459e-86cb-4e28-b48a-21929d46b490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:35.304274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-db91459e-86cb-4e28-b48a-21929d46b490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:35.372045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91459e-86cb-4e28-b48a-21929d46b490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:35.373662 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91459e-86cb-4e28-b48a-21929d46b490 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:35.384674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1125/2279] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:50:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:50:43.021933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=58,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:44.877195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e3cd-cdc7-4d55-b6eb-bf49f4edda03 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:44.945141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e3cd-cdc7-4d55-b6eb-bf49f4edda03 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:44.950931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:44.951567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:44.951846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:44.952121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] PATH_INFO: `/v3/users/43a1e3f35d264036ba475937e48a9588` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:44.953236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a1e3f35d264036ba475937e48a9588)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:44.955220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:44.982174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62870f4-8733-4a76-b493-c5941e24a34a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:44.982715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62870f4-8733-4a76-b493-c5941e24a34a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:44.982863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62870f4-8733-4a76-b493-c5941e24a34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:45.001713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c62870f4-8733-4a76-b493-c5941e24a34a None None] MFA Rules not processed for user `4489cb4f8ec144468b8308ba0a809539`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:45.007511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c62870f4-8733-4a76-b493-c5941e24a34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:45.057854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1126/2280] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:50:45.137022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a1e3f35d264036ba475937e48a9588'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:45.138294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a1e3f35d264036ba475937e48a9588'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:45.145738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a1e3f35d264036ba475937e48a9588'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:45.158369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a1e3f35d264036ba475937e48a9588'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:45.196798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a1e3f35d264036ba475937e48a9588'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:45.203723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1155/2281] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:50:44 2022] DELETE /identity/v3/users/43a1e3f35d264036ba475937e48a9588 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:45.208244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b91707-f0a2-4377-8c9f-cff64675fb0a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:45.208532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b91707-f0a2-4377-8c9f-cff64675fb0a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:45.208809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b91707-f0a2-4377-8c9f-cff64675fb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:45.228211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-73b91707-f0a2-4377-8c9f-cff64675fb0a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:45.229351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-73b91707-f0a2-4377-8c9f-cff64675fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:45.291347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1127/2282] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:50:45.301793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:45.303319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:45.363202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a05361-f8d9-4d93-8bc9-ad09cbe3df89 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:45.367121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cc3c1-18cb-44b4-9eca-fb256e411c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:45.367821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cc3c1-18cb-44b4-9eca-fb256e411c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:45.369806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cc3c1-18cb-44b4-9eca-fb256e411c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:45.369806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cc3c1-18cb-44b4-9eca-fb256e411c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:45.378799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cc3c1-18cb-44b4-9eca-fb256e411c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:45.380268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cc3c1-18cb-44b4-9eca-fb256e411c4a service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:45.391201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1156/2283] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:50:45.800341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b91707-f0a2-4377-8c9f-cff64675fb0a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:45.801762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-73b91707-f0a2-4377-8c9f-cff64675fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:45.813856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b91707-f0a2-4377-8c9f-cff64675fb0a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:45.819734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:45.820743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:45.821434 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:45.830248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] PATH_INFO: `/v3/projects/1ac930d4d3a24e0aad18077aa0275fde` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:45.841998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac930d4d3a24e0aad18077aa0275fde)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:45.844299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:45.868909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:45.943965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac930d4d3a24e0aad18077aa0275fde', 'request_id': 'req-8ca9b974-280b-430b-8745-2ff2093de6d5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:46.023224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac930d4d3a24e0aad18077aa0275fde', 'request_id': 'req-8ca9b974-280b-430b-8745-2ff2093de6d5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:46.031997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac930d4d3a24e0aad18077aa0275fde', 'request_id': 'req-8ca9b974-280b-430b-8745-2ff2093de6d5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:46.043104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] The token cache is being invalidate because project 1ac930d4d3a24e0aad18077aa0275fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:50:46.043397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:46.044059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-8ca9b974-280b-430b-8745-2ff2093de6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:46.045583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1128/2284] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:50:45 2022] DELETE /identity/v3/projects/1ac930d4d3a24e0aad18077aa0275fde => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:55.386479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:56.040008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:18.440924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e99a0-502c-40d3-99e8-acd0fd3e6196 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:18.441457 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e99a0-502c-40d3-99e8-acd0fd3e6196 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:18.441457 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e99a0-502c-40d3-99e8-acd0fd3e6196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:18.460000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b86e99a0-502c-40d3-99e8-acd0fd3e6196 None None] MFA Rules not processed for user `6e5963aeb4514b80a3d786da8a05da0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:18.461184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b86e99a0-502c-40d3-99e8-acd0fd3e6196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:18.514950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1157/2285] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:51:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:51:27.319998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bc27e-be46-4ee7-bffa-4a544ef99234 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:27.320516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bc27e-be46-4ee7-bffa-4a544ef99234 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:27.320617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bc27e-be46-4ee7-bffa-4a544ef99234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:27.341658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ed5bc27e-be46-4ee7-bffa-4a544ef99234 None None] MFA Rules not processed for user `23cfeac2a23e4f82a2d515db5c46ab6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:27.342900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ed5bc27e-be46-4ee7-bffa-4a544ef99234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:27.409559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1129/2286] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:51:28.508334 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=25 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:37.399154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=25 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:38.327741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08f4da-c1d9-4e40-9d8d-101b8ebef3e9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:38.328273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08f4da-c1d9-4e40-9d8d-101b8ebef3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:38.328405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08f4da-c1d9-4e40-9d8d-101b8ebef3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:38.352742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0e08f4da-c1d9-4e40-9d8d-101b8ebef3e9 None None] MFA Rules not processed for user `a26f0791dd7741ae8ff4065dc43f099e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:38.353956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0e08f4da-c1d9-4e40-9d8d-101b8ebef3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:38.413316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1158/2287] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:51:48.405914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=25 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:59.487038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b294cb1-704c-40b4-a597-37b86c54f2b9 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:59.487548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b294cb1-704c-40b4-a597-37b86c54f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:59.487649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b294cb1-704c-40b4-a597-37b86c54f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:59.507582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6b294cb1-704c-40b4-a597-37b86c54f2b9 None None] MFA Rules not processed for user `4489cb4f8ec144468b8308ba0a809539`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:59.508781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6b294cb1-704c-40b4-a597-37b86c54f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:59.565139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1130/2288] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:09.557896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=25 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:09.577851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08f4da-c1d9-4e40-9d8d-101b8ebef3e9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:09.579534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0e08f4da-c1d9-4e40-9d8d-101b8ebef3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:09.637379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08f4da-c1d9-4e40-9d8d-101b8ebef3e9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:09.641179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d25839-3da1-4120-8a21-9a81c7f20c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:09.641913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d25839-3da1-4120-8a21-9a81c7f20c34 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:09.642251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d25839-3da1-4120-8a21-9a81c7f20c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:09.642532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d25839-3da1-4120-8a21-9a81c7f20c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:09.644350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-95d25839-3da1-4120-8a21-9a81c7f20c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:09.731896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d25839-3da1-4120-8a21-9a81c7f20c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:09.733358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d25839-3da1-4120-8a21-9a81c7f20c34 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:09.744946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1159/2289] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:10.784244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b294cb1-704c-40b4-a597-37b86c54f2b9 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:10.794024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b294cb1-704c-40b4-a597-37b86c54f2b9 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:10.797704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28ccbc-ea80-4229-8636-50174f66252d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:10.798368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28ccbc-ea80-4229-8636-50174f66252d service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:10.798655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28ccbc-ea80-4229-8636-50174f66252d service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:10.798928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28ccbc-ea80-4229-8636-50174f66252d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:10.800645 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9d28ccbc-ea80-4229-8636-50174f66252d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:10.813527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28ccbc-ea80-4229-8636-50174f66252d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:10.814976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28ccbc-ea80-4229-8636-50174f66252d service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:10.826322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1131/2290] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:19.739402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=54 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:20.821601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=6 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:25.923345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d25839-3da1-4120-8a21-9a81c7f20c34 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:25.924997 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-95d25839-3da1-4120-8a21-9a81c7f20c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:25.939604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d25839-3da1-4120-8a21-9a81c7f20c34 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:25.945422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03bf7-076a-4fbe-8b72-46e8d01e8435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:25.946031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03bf7-076a-4fbe-8b72-46e8d01e8435 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:25.946357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03bf7-076a-4fbe-8b72-46e8d01e8435 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:25.946641 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03bf7-076a-4fbe-8b72-46e8d01e8435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:25.948336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2bc03bf7-076a-4fbe-8b72-46e8d01e8435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:25.958958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc03bf7-076a-4fbe-8b72-46e8d01e8435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:25.960829 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc03bf7-076a-4fbe-8b72-46e8d01e8435 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:25.970309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1160/2291] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:34.571430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28ccbc-ea80-4229-8636-50174f66252d service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:34.572937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9d28ccbc-ea80-4229-8636-50174f66252d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:34.588967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28ccbc-ea80-4229-8636-50174f66252d service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:34.592443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c069aa0-06bf-4870-b42c-bdc03741828d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:34.593041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069aa0-06bf-4870-b42c-bdc03741828d service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:34.593327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069aa0-06bf-4870-b42c-bdc03741828d service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:34.593604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069aa0-06bf-4870-b42c-bdc03741828d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:34.595335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9c069aa0-06bf-4870-b42c-bdc03741828d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:34.605545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c069aa0-06bf-4870-b42c-bdc03741828d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:34.607207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c069aa0-06bf-4870-b42c-bdc03741828d service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:34.616530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1132/2292] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:34.659176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03bf7-076a-4fbe-8b72-46e8d01e8435 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:34.660646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2bc03bf7-076a-4fbe-8b72-46e8d01e8435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:34.672267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03bf7-076a-4fbe-8b72-46e8d01e8435 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:34.675896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f7348-b06d-4d2b-b853-7894ad0b55fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:34.676499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f7348-b06d-4d2b-b853-7894ad0b55fc service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:34.676785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f7348-b06d-4d2b-b853-7894ad0b55fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:34.677071 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f7348-b06d-4d2b-b853-7894ad0b55fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:34.679265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-405f7348-b06d-4d2b-b853-7894ad0b55fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:34.743293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f7348-b06d-4d2b-b853-7894ad0b55fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:34.744721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f7348-b06d-4d2b-b853-7894ad0b55fc service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:34.754062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1161/2293] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:35.388505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9300e-e27b-42b6-92d7-2c9f47c21dd4 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:35.388791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9300e-e27b-42b6-92d7-2c9f47c21dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:35.389072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9300e-e27b-42b6-92d7-2c9f47c21dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:35.409976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-00a9300e-e27b-42b6-92d7-2c9f47c21dd4 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:35.411399 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-00a9300e-e27b-42b6-92d7-2c9f47c21dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:35.470907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1133/2294] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:35.690308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f7348-b06d-4d2b-b853-7894ad0b55fc service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:35.693356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-405f7348-b06d-4d2b-b853-7894ad0b55fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:35.769301 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f7348-b06d-4d2b-b853-7894ad0b55fc service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:35.775393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd86055-961c-4bca-b24c-a15a4f6b1ccd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:35.776119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86055-961c-4bca-b24c-a15a4f6b1ccd service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:35.776501 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86055-961c-4bca-b24c-a15a4f6b1ccd service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:35.776880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86055-961c-4bca-b24c-a15a4f6b1ccd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:35.786286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd86055-961c-4bca-b24c-a15a4f6b1ccd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:35.788157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd86055-961c-4bca-b24c-a15a4f6b1ccd service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:35.797454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1162/2295] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:52:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:52:38.402037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9300e-e27b-42b6-92d7-2c9f47c21dd4 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:38.419492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9300e-e27b-42b6-92d7-2c9f47c21dd4 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:38.430020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90c061-2853-43bc-a988-9669487caec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:38.430684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c061-2853-43bc-a988-9669487caec4 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:38.430970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c061-2853-43bc-a988-9669487caec4 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:38.431255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c061-2853-43bc-a988-9669487caec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:38.433155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6e90c061-2853-43bc-a988-9669487caec4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:38.449238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90c061-2853-43bc-a988-9669487caec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:38.451081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90c061-2853-43bc-a988-9669487caec4 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:38.473317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1134/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:39.541028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafa4d8-3abc-4659-bb8a-0f5129fb93ab None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:39.541617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafa4d8-3abc-4659-bb8a-0f5129fb93ab None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:39.541717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafa4d8-3abc-4659-bb8a-0f5129fb93ab None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:39.543187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1163/2297] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:52:39.550716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60fae-7fc9-4260-be89-869d60f12e6a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:39.551149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60fae-7fc9-4260-be89-869d60f12e6a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:39.551267 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60fae-7fc9-4260-be89-869d60f12e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:39.573712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5cd60fae-7fc9-4260-be89-869d60f12e6a None None] MFA Rules not processed for user `6fa8495c97df48f18b10039584d52f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:39.574944 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5cd60fae-7fc9-4260-be89-869d60f12e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:39.670139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1135/2298] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:52:39.682915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafa4d8-3abc-4659-bb8a-0f5129fb93ab None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:39.687126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6dafa4d8-3abc-4659-bb8a-0f5129fb93ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:39.705413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafa4d8-3abc-4659-bb8a-0f5129fb93ab None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:39.710934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7635a02-cf4c-4de3-81e7-e9c51ee963b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8495c97df48f18b10039584d52f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:39.711780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7635a02-cf4c-4de3-81e7-e9c51ee963b4 service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:39.712247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7635a02-cf4c-4de3-81e7-e9c51ee963b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:39.712529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7635a02-cf4c-4de3-81e7-e9c51ee963b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:39.724571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7635a02-cf4c-4de3-81e7-e9c51ee963b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:39.727406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7635a02-cf4c-4de3-81e7-e9c51ee963b4 service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:39.733588 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60fae-7fc9-4260-be89-869d60f12e6a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:39.736070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5cd60fae-7fc9-4260-be89-869d60f12e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:39.748985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1164/2299] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:39.758897 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60fae-7fc9-4260-be89-869d60f12e6a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:39.768517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:39.768517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:39.768517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:39.768517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] PATH_INFO: `/v3/users/23cfeac2a23e4f82a2d515db5c46ab6e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:39.768825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23cfeac2a23e4f82a2d515db5c46ab6e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:39.771071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:39.946849 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23cfeac2a23e4f82a2d515db5c46ab6e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:39.964483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23cfeac2a23e4f82a2d515db5c46ab6e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:39.971177 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:40.033508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23cfeac2a23e4f82a2d515db5c46ab6e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:40.045829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23cfeac2a23e4f82a2d515db5c46ab6e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:40.046758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6aab7d42-4880-4e58-98c5-cd34c4c600a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23cfeac2a23e4f82a2d515db5c46ab6e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:40.058514 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1136/2300] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:52:39 2022] DELETE /identity/v3/users/23cfeac2a23e4f82a2d515db5c46ab6e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:40.374635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7635a02-cf4c-4de3-81e7-e9c51ee963b4 service placement] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:40.390365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7635a02-cf4c-4de3-81e7-e9c51ee963b4 service placement] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:40.498405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:40.508184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:40.508987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:40.509332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:40.509677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] PATH_INFO: `/v3/projects/1614488b49c545beb824033e1ef56155` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:40.510936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1614488b49c545beb824033e1ef56155)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:40.512951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:40.666097 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1614488b49c545beb824033e1ef56155', 'request_id': 'req-75fec540-0457-499e-a9d4-58e70cb2862d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:40.673929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1614488b49c545beb824033e1ef56155', 'request_id': 'req-75fec540-0457-499e-a9d4-58e70cb2862d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:40.755122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1614488b49c545beb824033e1ef56155', 'request_id': 'req-75fec540-0457-499e-a9d4-58e70cb2862d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:40.774016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] The token cache is being invalidate because project 1614488b49c545beb824033e1ef56155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:52:40.774593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:40.775438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-75fec540-0457-499e-a9d4-58e70cb2862d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:40.781587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1165/2301] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:52:40 2022] DELETE /identity/v3/projects/1614488b49c545beb824033e1ef56155 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:40.782498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1139bf3-ddac-4424-9424-c7afd7853710 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:40.783371 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1139bf3-ddac-4424-9424-c7afd7853710 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:40.783975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1139bf3-ddac-4424-9424-c7afd7853710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:40.814342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e1139bf3-ddac-4424-9424-c7afd7853710 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:40.815885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e1139bf3-ddac-4424-9424-c7afd7853710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:40.937050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1137/2302] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:40.945904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06538097-3ec8-4601-8164-75e7b9eafc5a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:40.946334 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06538097-3ec8-4601-8164-75e7b9eafc5a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:40.946862 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06538097-3ec8-4601-8164-75e7b9eafc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:40.972986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-06538097-3ec8-4601-8164-75e7b9eafc5a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:40.974486 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-06538097-3ec8-4601-8164-75e7b9eafc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:40.984180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1166/2303] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:40.988312 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1139bf3-ddac-4424-9424-c7afd7853710 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:40.999712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1139bf3-ddac-4424-9424-c7afd7853710 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:41.009355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef6302-56b6-4e38-8258-a45e4a194d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:41.012716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef6302-56b6-4e38-8258-a45e4a194d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:41.013096 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef6302-56b6-4e38-8258-a45e4a194d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:41.013373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef6302-56b6-4e38-8258-a45e4a194d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:41.014069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef6302-56b6-4e38-8258-a45e4a194d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:52:41.014409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef6302-56b6-4e38-8258-a45e4a194d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:41.016081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef6302-56b6-4e38-8258-a45e4a194d28 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:41.043785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1138/2304] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:52:41.047974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06538097-3ec8-4601-8164-75e7b9eafc5a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:41.058778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06538097-3ec8-4601-8164-75e7b9eafc5a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:41.066423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3598e2e-c176-4629-9717-401106c58e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:41.067161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3598e2e-c176-4629-9717-401106c58e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:41.067446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3598e2e-c176-4629-9717-401106c58e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:41.067732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3598e2e-c176-4629-9717-401106c58e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:41.068361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3598e2e-c176-4629-9717-401106c58e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:41.070704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3598e2e-c176-4629-9717-401106c58e0e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:41.205442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1167/2305] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:41 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:41.211288 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef6302-56b6-4e38-8258-a45e4a194d28 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:41.222068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef6302-56b6-4e38-8258-a45e4a194d28 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:41.329804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f605-a6f8-4d95-8446-7b30cf8d6ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:41.330475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f605-a6f8-4d95-8446-7b30cf8d6ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:41.330761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f605-a6f8-4d95-8446-7b30cf8d6ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:41.331041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f605-a6f8-4d95-8446-7b30cf8d6ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:41.331705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f605-a6f8-4d95-8446-7b30cf8d6ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:41.333743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f605-a6f8-4d95-8446-7b30cf8d6ee9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:41.491335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1139/2306] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:41 2022] POST /identity/v3/users => generated 286 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:41.495338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3598e2e-c176-4629-9717-401106c58e0e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:41.507200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3598e2e-c176-4629-9717-401106c58e0e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:41.514277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e85b7-2f02-4ddd-a637-ed3b65a4694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:41.514919 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e85b7-2f02-4ddd-a637-ed3b65a4694a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:41.515207 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e85b7-2f02-4ddd-a637-ed3b65a4694a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:41.515490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e85b7-2f02-4ddd-a637-ed3b65a4694a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:41.516536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e85b7-2f02-4ddd-a637-ed3b65a4694a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:41.518315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e85b7-2f02-4ddd-a637-ed3b65a4694a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:41.534879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1168/2307] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:41.537714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f605-a6f8-4d95-8446-7b30cf8d6ee9 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:41.549052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f605-a6f8-4d95-8446-7b30cf8d6ee9 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:41.554623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14686c-bf08-4239-b7cb-ee0b062b1d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:41.555328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14686c-bf08-4239-b7cb-ee0b062b1d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:41.555913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14686c-bf08-4239-b7cb-ee0b062b1d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:41.556278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14686c-bf08-4239-b7cb-ee0b062b1d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:41.557002 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14686c-bf08-4239-b7cb-ee0b062b1d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:41.558981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14686c-bf08-4239-b7cb-ee0b062b1d50 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:41.577370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e85b7-2f02-4ddd-a637-ed3b65a4694a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:41.586346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1140/2308] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:41.590569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e85b7-2f02-4ddd-a637-ed3b65a4694a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:41.596151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531db5d-f792-4be9-9506-b60336936edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:41.596825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531db5d-f792-4be9-9506-b60336936edd admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:41.597114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531db5d-f792-4be9-9506-b60336936edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:41.597402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531db5d-f792-4be9-9506-b60336936edd admin admin] PATH_INFO: `/v3/projects/26887cb9d95d4f819170df3efb96d8ee/users/68301daff030408f877adea3f83ed331/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:41.619057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531db5d-f792-4be9-9506-b60336936edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=26887cb9d95d4f819170df3efb96d8ee, user_id=68301daff030408f877adea3f83ed331, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:41.621753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531db5d-f792-4be9-9506-b60336936edd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:41.720767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1169/2309] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:41 2022] PUT /identity/v3/projects/26887cb9d95d4f819170df3efb96d8ee/users/68301daff030408f877adea3f83ed331/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:41.734617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123618e-91d2-4a87-9101-68998393c0b4 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:41.734905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123618e-91d2-4a87-9101-68998393c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:41.735188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123618e-91d2-4a87-9101-68998393c0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:41.769539 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1123618e-91d2-4a87-9101-68998393c0b4 None None] MFA Rules not processed for user `68301daff030408f877adea3f83ed331`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:41.770873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1123618e-91d2-4a87-9101-68998393c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:41.826279 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:41.853472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1141/2310] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:52:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:41.857674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531db5d-f792-4be9-9506-b60336936edd admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:41.938012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531db5d-f792-4be9-9506-b60336936edd admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:41.945773 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181734e3-7e0a-4989-9136-bd17e8a020a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:41.946423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181734e3-7e0a-4989-9136-bd17e8a020a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:41.946724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181734e3-7e0a-4989-9136-bd17e8a020a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:41.947122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181734e3-7e0a-4989-9136-bd17e8a020a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:41.947648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181734e3-7e0a-4989-9136-bd17e8a020a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:41.949771 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181734e3-7e0a-4989-9136-bd17e8a020a6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:42.107564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1170/2311] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:41 2022] POST /identity/v3/projects => generated 369 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:52:42.107739 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123618e-91d2-4a87-9101-68998393c0b4 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:42.108848 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123618e-91d2-4a87-9101-68998393c0b4 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:42.199987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb91a2-3495-4ceb-b494-c16e2a66ab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:42.200660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb91a2-3495-4ceb-b494-c16e2a66ab22 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:42.200965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb91a2-3495-4ceb-b494-c16e2a66ab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:42.201220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb91a2-3495-4ceb-b494-c16e2a66ab22 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:42.201872 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb91a2-3495-4ceb-b494-c16e2a66ab22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:42.203859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb91a2-3495-4ceb-b494-c16e2a66ab22 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:42.315822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1142/2312] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:42 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:42.316919 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181734e3-7e0a-4989-9136-bd17e8a020a6 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:42.332207 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181734e3-7e0a-4989-9136-bd17e8a020a6 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:42.338131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8138d-d788-4a5b-8e1c-65ff0b997fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:42.338784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8138d-d788-4a5b-8e1c-65ff0b997fce admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:42.339331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8138d-d788-4a5b-8e1c-65ff0b997fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:42.339616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8138d-d788-4a5b-8e1c-65ff0b997fce admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:42.340276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8138d-d788-4a5b-8e1c-65ff0b997fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:42.342028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8138d-d788-4a5b-8e1c-65ff0b997fce admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:42.345482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:42.355339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1171/2313] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:42.359753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb91a2-3495-4ceb-b494-c16e2a66ab22 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:42.380107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb91a2-3495-4ceb-b494-c16e2a66ab22 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:42.385348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b17b87-eb74-40b6-b6ec-c1d02cc4555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:42.386183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17b87-eb74-40b6-b6ec-c1d02cc4555a admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:42.386488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17b87-eb74-40b6-b6ec-c1d02cc4555a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:42.386867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17b87-eb74-40b6-b6ec-c1d02cc4555a admin admin] PATH_INFO: `/v3/projects/3ba3ba6e84e3476cab07d0300d7510d3/users/94c2262657814e4f99dfe25dfd0bb816/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:42.402233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b17b87-eb74-40b6-b6ec-c1d02cc4555a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba3ba6e84e3476cab07d0300d7510d3, user_id=94c2262657814e4f99dfe25dfd0bb816, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:42.404867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b17b87-eb74-40b6-b6ec-c1d02cc4555a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:42.662221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1143/2314] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:42 2022] PUT /identity/v3/projects/3ba3ba6e84e3476cab07d0300d7510d3/users/94c2262657814e4f99dfe25dfd0bb816/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:42.666300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8138d-d788-4a5b-8e1c-65ff0b997fce admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:42.677665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8138d-d788-4a5b-8e1c-65ff0b997fce admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:42.743515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aded6a-527f-4288-b3a2-6c04c4407169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:42.746366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aded6a-527f-4288-b3a2-6c04c4407169 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:42.746366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aded6a-527f-4288-b3a2-6c04c4407169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:42.746366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aded6a-527f-4288-b3a2-6c04c4407169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:42.746366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aded6a-527f-4288-b3a2-6c04c4407169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:42.747106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aded6a-527f-4288-b3a2-6c04c4407169 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:42.757423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1172/2315] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:42.764871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b17b87-eb74-40b6-b6ec-c1d02cc4555a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:42.776145 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b17b87-eb74-40b6-b6ec-c1d02cc4555a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:42.781003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4639da-0932-4c58-81a6-ca699bb3ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:42.781655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4639da-0932-4c58-81a6-ca699bb3ad16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:42.781937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4639da-0932-4c58-81a6-ca699bb3ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:42.782289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4639da-0932-4c58-81a6-ca699bb3ad16 admin admin] PATH_INFO: `/v3/projects/3ba3ba6e84e3476cab07d0300d7510d3/users/94c2262657814e4f99dfe25dfd0bb816/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:42.784236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4639da-0932-4c58-81a6-ca699bb3ad16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba3ba6e84e3476cab07d0300d7510d3, user_id=94c2262657814e4f99dfe25dfd0bb816, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:42.786943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4639da-0932-4c58-81a6-ca699bb3ad16 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:42.797305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1144/2316] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:42 2022] PUT /identity/v3/projects/3ba3ba6e84e3476cab07d0300d7510d3/users/94c2262657814e4f99dfe25dfd0bb816/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:42.815428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ab9c-df9c-4f23-887f-ce5a97886366 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:42.815713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ab9c-df9c-4f23-887f-ce5a97886366 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:42.815990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ab9c-df9c-4f23-887f-ce5a97886366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:42.844310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1b57ab9c-df9c-4f23-887f-ce5a97886366 None None] MFA Rules not processed for user `94c2262657814e4f99dfe25dfd0bb816`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:42.845516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1b57ab9c-df9c-4f23-887f-ce5a97886366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:42.914273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1173/2317] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:42.926924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4639da-0932-4c58-81a6-ca699bb3ad16 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:42.930079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0d4639da-0932-4c58-81a6-ca699bb3ad16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:43.003355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4639da-0932-4c58-81a6-ca699bb3ad16 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:43.009957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d181b-2a88-4bff-aa3a-29f495d1567e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:43.010615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d181b-2a88-4bff-aa3a-29f495d1567e service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:43.010938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d181b-2a88-4bff-aa3a-29f495d1567e service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:43.011272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d181b-2a88-4bff-aa3a-29f495d1567e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:43.021791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d181b-2a88-4bff-aa3a-29f495d1567e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:43.023640 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d181b-2a88-4bff-aa3a-29f495d1567e service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:43.035179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1145/2318] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:44.585976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57ab9c-df9c-4f23-887f-ce5a97886366 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:44.688354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57ab9c-df9c-4f23-887f-ce5a97886366 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:44.696185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:44.697450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:44.697739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:44.698019 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] PATH_INFO: `/v3/users/68301daff030408f877adea3f83ed331` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:44.699514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68301daff030408f877adea3f83ed331)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:44.702185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:44.734726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:44.913362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68301daff030408f877adea3f83ed331'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:44.914218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68301daff030408f877adea3f83ed331'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:44.921711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68301daff030408f877adea3f83ed331'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:44.935117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68301daff030408f877adea3f83ed331'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:45.039843 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68301daff030408f877adea3f83ed331'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:45.046570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1174/2319] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:52:44 2022] DELETE /identity/v3/users/68301daff030408f877adea3f83ed331 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:45.051354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e13a5-d3ef-482f-a5d4-5d676d5f135a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:45.051863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e13a5-d3ef-482f-a5d4-5d676d5f135a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:45.052244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e13a5-d3ef-482f-a5d4-5d676d5f135a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:45.076550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ec5e13a5-d3ef-482f-a5d4-5d676d5f135a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:45.077713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ec5e13a5-d3ef-482f-a5d4-5d676d5f135a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:45.120126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:45.148789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1146/2320] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:45.158727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:45.160260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:45.237548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bc2f0-a996-49c4-a828-d70b361f1842 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:45.241867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62145a3-feb3-409e-a60f-6823f8db86e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:45.242721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62145a3-feb3-409e-a60f-6823f8db86e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:45.243008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62145a3-feb3-409e-a60f-6823f8db86e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:45.244232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62145a3-feb3-409e-a60f-6823f8db86e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:45.255275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62145a3-feb3-409e-a60f-6823f8db86e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:45.257570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62145a3-feb3-409e-a60f-6823f8db86e0 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:45.269512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1175/2321] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:46.152162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e13a5-d3ef-482f-a5d4-5d676d5f135a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:46.153716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ec5e13a5-d3ef-482f-a5d4-5d676d5f135a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:46.166115 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e13a5-d3ef-482f-a5d4-5d676d5f135a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:46.170713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:46.171350 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:46.171633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:46.171973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] PATH_INFO: `/v3/projects/26887cb9d95d4f819170df3efb96d8ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:46.173095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26887cb9d95d4f819170df3efb96d8ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:46.175059 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:46.333795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26887cb9d95d4f819170df3efb96d8ee', 'request_id': 'req-f6303308-28be-4a5d-a41b-6a731165035a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.477183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26887cb9d95d4f819170df3efb96d8ee', 'request_id': 'req-f6303308-28be-4a5d-a41b-6a731165035a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.483332 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26887cb9d95d4f819170df3efb96d8ee', 'request_id': 'req-f6303308-28be-4a5d-a41b-6a731165035a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.495644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] The token cache is being invalidate because project 26887cb9d95d4f819170df3efb96d8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:52:46.495940 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.496582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.498155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1147/2322] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:52:46 2022] DELETE /identity/v3/projects/26887cb9d95d4f819170df3efb96d8ee => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:46.502415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62145a3-feb3-409e-a60f-6823f8db86e0 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:46.512678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62145a3-feb3-409e-a60f-6823f8db86e0 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:46.570154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:46.570874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:46.571153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:46.571423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] PATH_INFO: `/v3/users/94c2262657814e4f99dfe25dfd0bb816` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:46.572586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c2262657814e4f99dfe25dfd0bb816)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:46.574542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:46.898356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:46.901543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c2262657814e4f99dfe25dfd0bb816'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.902237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c2262657814e4f99dfe25dfd0bb816'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.909941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c2262657814e4f99dfe25dfd0bb816'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.924602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c2262657814e4f99dfe25dfd0bb816'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:47.016291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-72660b56-7451-492a-b0bd-3f8948417255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c2262657814e4f99dfe25dfd0bb816'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:47.024215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1176/2323] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:52:46 2022] DELETE /identity/v3/users/94c2262657814e4f99dfe25dfd0bb816 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:47.629465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:47.630937 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:47.645505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303308-28be-4a5d-a41b-6a731165035a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:47.706956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:47.707655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:47.707927 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:47.708204 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] PATH_INFO: `/v3/projects/3ba3ba6e84e3476cab07d0300d7510d3` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:47.709365 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba3ba6e84e3476cab07d0300d7510d3)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:47.711641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:47.880925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba3ba6e84e3476cab07d0300d7510d3', 'request_id': 'req-4bff587d-715b-4add-bcbf-ed9258445f36'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:47.976284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba3ba6e84e3476cab07d0300d7510d3', 'request_id': 'req-4bff587d-715b-4add-bcbf-ed9258445f36'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:47.981914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:47.984174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba3ba6e84e3476cab07d0300d7510d3', 'request_id': 'req-4bff587d-715b-4add-bcbf-ed9258445f36'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:47.994443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] The token cache is being invalidate because project 3ba3ba6e84e3476cab07d0300d7510d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:52:47.994736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:47.995398 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4bff587d-715b-4add-bcbf-ed9258445f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:47.997065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1148/2324] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:52:47 2022] DELETE /identity/v3/projects/3ba3ba6e84e3476cab07d0300d7510d3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:48.002047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d165dfc-2c3f-4ab1-8d2e-5f90d80fff55 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.002556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d165dfc-2c3f-4ab1-8d2e-5f90d80fff55 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.002668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d165dfc-2c3f-4ab1-8d2e-5f90d80fff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:48.022219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4d165dfc-2c3f-4ab1-8d2e-5f90d80fff55 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:48.024038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4d165dfc-2c3f-4ab1-8d2e-5f90d80fff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:48.081314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1177/2325] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:48.089840 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ada7b8-8b50-4ac9-a056-dbedfffb179e None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.090337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ada7b8-8b50-4ac9-a056-dbedfffb179e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.090490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ada7b8-8b50-4ac9-a056-dbedfffb179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:48.112160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-02ada7b8-8b50-4ac9-a056-dbedfffb179e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:48.113362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-02ada7b8-8b50-4ac9-a056-dbedfffb179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:48.121826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1149/2326] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:52:48.126326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d165dfc-2c3f-4ab1-8d2e-5f90d80fff55 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:48.135921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d165dfc-2c3f-4ab1-8d2e-5f90d80fff55 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:48.140513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a48d-7956-40a8-a91a-39ebd2b9deb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:48.141150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a48d-7956-40a8-a91a-39ebd2b9deb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.141382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a48d-7956-40a8-a91a-39ebd2b9deb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.141652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a48d-7956-40a8-a91a-39ebd2b9deb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:48.142323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a48d-7956-40a8-a91a-39ebd2b9deb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:52:48.142625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a48d-7956-40a8-a91a-39ebd2b9deb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:48.144202 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a48d-7956-40a8-a91a-39ebd2b9deb5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:48.156113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1178/2327] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:52:48.160481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ada7b8-8b50-4ac9-a056-dbedfffb179e None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:48.172827 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ada7b8-8b50-4ac9-a056-dbedfffb179e None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:48.177680 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4029-53e7-4dd6-bd44-c31fc41e7014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:48.178322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4029-53e7-4dd6-bd44-c31fc41e7014 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.178607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4029-53e7-4dd6-bd44-c31fc41e7014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.179035 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4029-53e7-4dd6-bd44-c31fc41e7014 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:48.179714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4029-53e7-4dd6-bd44-c31fc41e7014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:48.181656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4029-53e7-4dd6-bd44-c31fc41e7014 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:48.265593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1150/2328] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:48 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:48.268893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a48d-7956-40a8-a91a-39ebd2b9deb5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:48.279479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a48d-7956-40a8-a91a-39ebd2b9deb5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:48.339518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9356a7-6910-4b19-9766-4146af285005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:48.340252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9356a7-6910-4b19-9766-4146af285005 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.340490 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9356a7-6910-4b19-9766-4146af285005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.340683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9356a7-6910-4b19-9766-4146af285005 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:48.341314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9356a7-6910-4b19-9766-4146af285005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:48.343268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9356a7-6910-4b19-9766-4146af285005 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:48.433713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1179/2329] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:48 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:48.438497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4029-53e7-4dd6-bd44-c31fc41e7014 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:48.449784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4029-53e7-4dd6-bd44-c31fc41e7014 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:48.454576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7280359-fc5b-4cd3-9bbf-30f7de73ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:48.455177 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7280359-fc5b-4cd3-9bbf-30f7de73ba97 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.455460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7280359-fc5b-4cd3-9bbf-30f7de73ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.455735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7280359-fc5b-4cd3-9bbf-30f7de73ba97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:48.456379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7280359-fc5b-4cd3-9bbf-30f7de73ba97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:48.458235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7280359-fc5b-4cd3-9bbf-30f7de73ba97 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:48.470123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1151/2330] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:48.474164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9356a7-6910-4b19-9766-4146af285005 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:48.484750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9356a7-6910-4b19-9766-4146af285005 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:48.489441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91666fca-3f8c-4778-a350-39d9d7093182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:48.490043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666fca-3f8c-4778-a350-39d9d7093182 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.490387 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666fca-3f8c-4778-a350-39d9d7093182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.490669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666fca-3f8c-4778-a350-39d9d7093182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:48.491392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91666fca-3f8c-4778-a350-39d9d7093182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:48.493424 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91666fca-3f8c-4778-a350-39d9d7093182 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:48.504437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1180/2331] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:48.511071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7280359-fc5b-4cd3-9bbf-30f7de73ba97 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:48.521135 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7280359-fc5b-4cd3-9bbf-30f7de73ba97 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:48.526655 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090a871-651e-466a-9014-6166dce5786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:48.527303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090a871-651e-466a-9014-6166dce5786f admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.527590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090a871-651e-466a-9014-6166dce5786f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.527872 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090a871-651e-466a-9014-6166dce5786f admin admin] PATH_INFO: `/v3/projects/6f913534ae9c46abb2781a1cb2c73f3f/users/25bb864c113f4bf590eaff6e5db6f760/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:48.542433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090a871-651e-466a-9014-6166dce5786f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f913534ae9c46abb2781a1cb2c73f3f, user_id=25bb864c113f4bf590eaff6e5db6f760, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:48.545253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090a871-651e-466a-9014-6166dce5786f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:48.659668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1152/2332] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:48 2022] PUT /identity/v3/projects/6f913534ae9c46abb2781a1cb2c73f3f/users/25bb864c113f4bf590eaff6e5db6f760/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:48.669725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39920377-6654-4f92-8546-d54b1ab876ff None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.670039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39920377-6654-4f92-8546-d54b1ab876ff None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.670358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39920377-6654-4f92-8546-d54b1ab876ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:48.702670 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-39920377-6654-4f92-8546-d54b1ab876ff None None] MFA Rules not processed for user `25bb864c113f4bf590eaff6e5db6f760`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:48.703876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-39920377-6654-4f92-8546-d54b1ab876ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:48.716967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:48.768179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1181/2333] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:48.772757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090a871-651e-466a-9014-6166dce5786f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:48.834559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090a871-651e-466a-9014-6166dce5786f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:48.839865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37225fb9-7366-435a-9bc7-0e74739a2f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:48.840496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37225fb9-7366-435a-9bc7-0e74739a2f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.840774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37225fb9-7366-435a-9bc7-0e74739a2f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.841045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37225fb9-7366-435a-9bc7-0e74739a2f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:48.841674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37225fb9-7366-435a-9bc7-0e74739a2f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:48.843595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37225fb9-7366-435a-9bc7-0e74739a2f48 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:48.925193 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1153/2334] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:48 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:52:48.929887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39920377-6654-4f92-8546-d54b1ab876ff None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:48.940420 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39920377-6654-4f92-8546-d54b1ab876ff None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:48.998638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a6c9-b86b-4920-9736-6ebda292ba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:48.999251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a6c9-b86b-4920-9736-6ebda292ba8c admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.999534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a6c9-b86b-4920-9736-6ebda292ba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.999807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a6c9-b86b-4920-9736-6ebda292ba8c admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.000451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4a6c9-b86b-4920-9736-6ebda292ba8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:49.002398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4a6c9-b86b-4920-9736-6ebda292ba8c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:49.077510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1182/2335] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:48 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:52:49.081726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37225fb9-7366-435a-9bc7-0e74739a2f48 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:49.093087 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37225fb9-7366-435a-9bc7-0e74739a2f48 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:49.098007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a553f-9fe2-4584-8ff9-9272978858e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:49.098713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a553f-9fe2-4584-8ff9-9272978858e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:49.098999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a553f-9fe2-4584-8ff9-9272978858e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:49.099273 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a553f-9fe2-4584-8ff9-9272978858e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.100037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a553f-9fe2-4584-8ff9-9272978858e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:49.101915 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a553f-9fe2-4584-8ff9-9272978858e0 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:49.112934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1154/2336] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:49.117817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a6c9-b86b-4920-9736-6ebda292ba8c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:49.127933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a6c9-b86b-4920-9736-6ebda292ba8c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:49.133853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75635fbc-5033-4cf3-b404-53dc6408cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:49.134479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75635fbc-5033-4cf3-b404-53dc6408cf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:49.134767 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75635fbc-5033-4cf3-b404-53dc6408cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:49.135044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75635fbc-5033-4cf3-b404-53dc6408cf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.135685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75635fbc-5033-4cf3-b404-53dc6408cf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:49.137278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75635fbc-5033-4cf3-b404-53dc6408cf1c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:49.148164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1183/2337] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:52:49.152299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a553f-9fe2-4584-8ff9-9272978858e0 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:49.162307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a553f-9fe2-4584-8ff9-9272978858e0 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:49.167399 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba90a7-25c1-4fd3-a0d8-434691b7907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:49.168037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba90a7-25c1-4fd3-a0d8-434691b7907e admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:49.168318 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba90a7-25c1-4fd3-a0d8-434691b7907e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:49.168594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba90a7-25c1-4fd3-a0d8-434691b7907e admin admin] PATH_INFO: `/v3/projects/5a7e22f9a2b84296a9eee5113dedd6cf/users/2eaf094284c84bc18cbd3e02d9bcae29/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.184032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba90a7-25c1-4fd3-a0d8-434691b7907e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7e22f9a2b84296a9eee5113dedd6cf, user_id=2eaf094284c84bc18cbd3e02d9bcae29, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:49.186757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba90a7-25c1-4fd3-a0d8-434691b7907e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:49.265336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1155/2338] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:49 2022] PUT /identity/v3/projects/5a7e22f9a2b84296a9eee5113dedd6cf/users/2eaf094284c84bc18cbd3e02d9bcae29/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:49.284014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5260dff-5688-4475-8d32-022c2993f570 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:49.284306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5260dff-5688-4475-8d32-022c2993f570 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:49.284589 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5260dff-5688-4475-8d32-022c2993f570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.314661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f5260dff-5688-4475-8d32-022c2993f570 None None] MFA Rules not processed for user `2eaf094284c84bc18cbd3e02d9bcae29`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:49.315878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f5260dff-5688-4475-8d32-022c2993f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:49.385193 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1184/2339] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:52:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:49.389757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba90a7-25c1-4fd3-a0d8-434691b7907e admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:49.456104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:49.483112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba90a7-25c1-4fd3-a0d8-434691b7907e admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:49.487392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76760362-0991-4707-8f9f-02e059991284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:49.488234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760362-0991-4707-8f9f-02e059991284 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:49.488515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760362-0991-4707-8f9f-02e059991284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:49.488787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760362-0991-4707-8f9f-02e059991284 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.489428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76760362-0991-4707-8f9f-02e059991284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:49.491733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76760362-0991-4707-8f9f-02e059991284 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:49.589785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1156/2340] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:49 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:49.593886 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5260dff-5688-4475-8d32-022c2993f570 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:49.605546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5260dff-5688-4475-8d32-022c2993f570 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:49.625508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:49.660996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbb191-9fff-41c1-8dcc-f2b166e2ba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:49.661646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb191-9fff-41c1-8dcc-f2b166e2ba0c admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:49.661932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb191-9fff-41c1-8dcc-f2b166e2ba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:49.662225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb191-9fff-41c1-8dcc-f2b166e2ba0c admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.671881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbb191-9fff-41c1-8dcc-f2b166e2ba0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:49.671881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbb191-9fff-41c1-8dcc-f2b166e2ba0c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:49.713973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76760362-0991-4707-8f9f-02e059991284 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:49.715920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-76760362-0991-4707-8f9f-02e059991284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:49.774463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76760362-0991-4707-8f9f-02e059991284 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:49.778316 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bb24c-a4ba-41ee-a666-14325a7fbeca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:49.778805 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bb24c-a4ba-41ee-a666-14325a7fbeca service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:49.779118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bb24c-a4ba-41ee-a666-14325a7fbeca service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:49.779401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bb24c-a4ba-41ee-a666-14325a7fbeca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.781170 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c15bb24c-a4ba-41ee-a666-14325a7fbeca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:49.791260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bb24c-a4ba-41ee-a666-14325a7fbeca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:49.792712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bb24c-a4ba-41ee-a666-14325a7fbeca service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:49.800718 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1157/2341] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:52:49.805408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1185/2342] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:49 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:49.812703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bb24c-a4ba-41ee-a666-14325a7fbeca service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:49.817587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bb24c-a4ba-41ee-a666-14325a7fbeca service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:49.823298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefde4ca-15ae-4b80-a640-1fd29ce86ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:49.823963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde4ca-15ae-4b80-a640-1fd29ce86ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:49.824243 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde4ca-15ae-4b80-a640-1fd29ce86ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:49.824516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde4ca-15ae-4b80-a640-1fd29ce86ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.825151 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefde4ca-15ae-4b80-a640-1fd29ce86ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:49.826798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefde4ca-15ae-4b80-a640-1fd29ce86ba2 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:49.838550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1158/2343] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:49.851636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbb191-9fff-41c1-8dcc-f2b166e2ba0c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:49.854249 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbb191-9fff-41c1-8dcc-f2b166e2ba0c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:49.859352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653141-87b4-4e1c-8688-4f6cb7516553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:49.859859 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653141-87b4-4e1c-8688-4f6cb7516553 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:49.860478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653141-87b4-4e1c-8688-4f6cb7516553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:49.860478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653141-87b4-4e1c-8688-4f6cb7516553 admin admin] PATH_INFO: `/v3/projects/1f954670380b48a191fa2ec5fa941bd1/users/9efad03dba5a440abb48805d549f575e/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.877004 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69653141-87b4-4e1c-8688-4f6cb7516553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f954670380b48a191fa2ec5fa941bd1, user_id=9efad03dba5a440abb48805d549f575e, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:49.879880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69653141-87b4-4e1c-8688-4f6cb7516553 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:50.017416 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1186/2344] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:49 2022] PUT /identity/v3/projects/1f954670380b48a191fa2ec5fa941bd1/users/9efad03dba5a440abb48805d549f575e/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:50.021406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefde4ca-15ae-4b80-a640-1fd29ce86ba2 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:50.035408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefde4ca-15ae-4b80-a640-1fd29ce86ba2 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:50.100733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eb75f-b34c-4e91-8aaf-97c20400210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:50.101917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb75f-b34c-4e91-8aaf-97c20400210a admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:50.102356 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb75f-b34c-4e91-8aaf-97c20400210a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:50.102720 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb75f-b34c-4e91-8aaf-97c20400210a admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:50.103478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eb75f-b34c-4e91-8aaf-97c20400210a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:50.105223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eb75f-b34c-4e91-8aaf-97c20400210a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:50.117001 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1159/2345] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:50.121381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653141-87b4-4e1c-8688-4f6cb7516553 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:50.133020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653141-87b4-4e1c-8688-4f6cb7516553 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:50.138357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becf314-9a16-4b41-9f2f-5d1229fad262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:50.139046 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becf314-9a16-4b41-9f2f-5d1229fad262 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:50.139329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becf314-9a16-4b41-9f2f-5d1229fad262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:50.139609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becf314-9a16-4b41-9f2f-5d1229fad262 admin admin] PATH_INFO: `/v3/projects/1f954670380b48a191fa2ec5fa941bd1/users/9efad03dba5a440abb48805d549f575e/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:50.141536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becf314-9a16-4b41-9f2f-5d1229fad262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f954670380b48a191fa2ec5fa941bd1, user_id=9efad03dba5a440abb48805d549f575e, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:50.144351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becf314-9a16-4b41-9f2f-5d1229fad262 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:50.156530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1187/2346] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:50 2022] PUT /identity/v3/projects/1f954670380b48a191fa2ec5fa941bd1/users/9efad03dba5a440abb48805d549f575e/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:50.167623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138a2fc-953c-46a4-b654-76d163413592 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:50.168070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138a2fc-953c-46a4-b654-76d163413592 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:50.168786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138a2fc-953c-46a4-b654-76d163413592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:50.211869 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a138a2fc-953c-46a4-b654-76d163413592 None None] MFA Rules not processed for user `9efad03dba5a440abb48805d549f575e`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:50.213103 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a138a2fc-953c-46a4-b654-76d163413592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:50.255453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:50.284339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1160/2347] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:52:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:50.295985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becf314-9a16-4b41-9f2f-5d1229fad262 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:50.305061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0becf314-9a16-4b41-9f2f-5d1229fad262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:50.359405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becf314-9a16-4b41-9f2f-5d1229fad262 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:50.363155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e737641-9c19-4459-9721-46b2070b392e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:50.363881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e737641-9c19-4459-9721-46b2070b392e service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:50.364296 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e737641-9c19-4459-9721-46b2070b392e service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:50.364610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e737641-9c19-4459-9721-46b2070b392e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:50.375172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e737641-9c19-4459-9721-46b2070b392e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:50.376614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e737641-9c19-4459-9721-46b2070b392e service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:50.387432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1188/2348] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:52.056771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138a2fc-953c-46a4-b654-76d163413592 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:52.058164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a138a2fc-953c-46a4-b654-76d163413592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:52.070454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138a2fc-953c-46a4-b654-76d163413592 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:52.073940 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996cb42-88d3-4e7e-ad5d-6a34f7cf732b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:52.074567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996cb42-88d3-4e7e-ad5d-6a34f7cf732b service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:52.074872 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996cb42-88d3-4e7e-ad5d-6a34f7cf732b service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:52.075139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996cb42-88d3-4e7e-ad5d-6a34f7cf732b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:52.131621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996cb42-88d3-4e7e-ad5d-6a34f7cf732b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:52.133070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996cb42-88d3-4e7e-ad5d-6a34f7cf732b service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:52.141829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1161/2349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:53.567115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e737641-9c19-4459-9721-46b2070b392e service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:53.569855 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2e737641-9c19-4459-9721-46b2070b392e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:53.656407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e737641-9c19-4459-9721-46b2070b392e service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:53.662177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64cb4-fb12-45ab-9edf-1613b9c6e61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:53.662818 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64cb4-fb12-45ab-9edf-1613b9c6e61d service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:53.663102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64cb4-fb12-45ab-9edf-1613b9c6e61d service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:53.663376 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64cb4-fb12-45ab-9edf-1613b9c6e61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:53.665773 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9eb64cb4-fb12-45ab-9edf-1613b9c6e61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:53.683487 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:53.727894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb64cb4-fb12-45ab-9edf-1613b9c6e61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:53.729486 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb64cb4-fb12-45ab-9edf-1613b9c6e61d service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:53.738408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1189/2350] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:53.913163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996cb42-88d3-4e7e-ad5d-6a34f7cf732b service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:53.939494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996cb42-88d3-4e7e-ad5d-6a34f7cf732b service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:53.948433 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99475b2e-f031-4cc7-926f-b047994dead1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:53.949401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475b2e-f031-4cc7-926f-b047994dead1 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:53.949704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475b2e-f031-4cc7-926f-b047994dead1 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:53.950055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475b2e-f031-4cc7-926f-b047994dead1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:53.952899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-99475b2e-f031-4cc7-926f-b047994dead1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:53.974326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99475b2e-f031-4cc7-926f-b047994dead1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:53.977758 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99475b2e-f031-4cc7-926f-b047994dead1 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:53.988043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1162/2351] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:57.676411 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64cb4-fb12-45ab-9edf-1613b9c6e61d service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:57.687495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64cb4-fb12-45ab-9edf-1613b9c6e61d service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:57.691439 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3c07c-03c6-409a-87d9-001b608ccb94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:57.692418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3c07c-03c6-409a-87d9-001b608ccb94 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:57.692768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3c07c-03c6-409a-87d9-001b608ccb94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:57.694471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3c07c-03c6-409a-87d9-001b608ccb94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:57.781999 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3c07c-03c6-409a-87d9-001b608ccb94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:57.783578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3c07c-03c6-409a-87d9-001b608ccb94 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:57.794414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99475b2e-f031-4cc7-926f-b047994dead1 service nova] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:57.795965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-99475b2e-f031-4cc7-926f-b047994dead1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:57.808701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1190/2352] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:57.894580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99475b2e-f031-4cc7-926f-b047994dead1 service nova] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:57.902301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22460aab-e42c-46e2-9762-d4ddaa74a95d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8495c97df48f18b10039584d52f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:57.905074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22460aab-e42c-46e2-9762-d4ddaa74a95d service placement] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:57.905074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22460aab-e42c-46e2-9762-d4ddaa74a95d service placement] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:57.905074 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22460aab-e42c-46e2-9762-d4ddaa74a95d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:57.910862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-22460aab-e42c-46e2-9762-d4ddaa74a95d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:57.927454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22460aab-e42c-46e2-9762-d4ddaa74a95d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:57.929192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22460aab-e42c-46e2-9762-d4ddaa74a95d service placement] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:57.940287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1163/2353] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:59.204427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3c07c-03c6-409a-87d9-001b608ccb94 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:59.258813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3c07c-03c6-409a-87d9-001b608ccb94 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:59.262437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c082e5-fb0c-4bc2-a9ab-fef6e8426375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:59.263041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c082e5-fb0c-4bc2-a9ab-fef6e8426375 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:59.263343 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c082e5-fb0c-4bc2-a9ab-fef6e8426375 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:59.263622 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c082e5-fb0c-4bc2-a9ab-fef6e8426375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:59.265341 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f9c082e5-fb0c-4bc2-a9ab-fef6e8426375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:59.275775 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c082e5-fb0c-4bc2-a9ab-fef6e8426375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:59.277213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c082e5-fb0c-4bc2-a9ab-fef6e8426375 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:59.285189 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1191/2354] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:59.933424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d03c3-9651-40fa-99e1-694a90fcf7d5 None None] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:59.933952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d03c3-9651-40fa-99e1-694a90fcf7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:59.934050 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d03c3-9651-40fa-99e1-694a90fcf7d5 None None] PATH_INFO: `/` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:59.935425 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1164/2355] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:52:59.941498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77eacbd-48c3-4092-82f3-7c63c26cf51a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:59.941791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77eacbd-48c3-4092-82f3-7c63c26cf51a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:59.942075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77eacbd-48c3-4092-82f3-7c63c26cf51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:59.962510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d77eacbd-48c3-4092-82f3-7c63c26cf51a None None] MFA Rules not processed for user `948a5df1d4244c839a7faeb54f93dfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:59.963810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d77eacbd-48c3-4092-82f3-7c63c26cf51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:59.970810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1192/2356] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:52:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:52:59.982645 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d03c3-9651-40fa-99e1-694a90fcf7d5 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:59.998484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d03c3-9651-40fa-99e1-694a90fcf7d5 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:00.002020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861af4d6-930e-4207-a5ff-8024290de770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:00.002759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861af4d6-930e-4207-a5ff-8024290de770 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:00.003095 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861af4d6-930e-4207-a5ff-8024290de770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:00.003374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861af4d6-930e-4207-a5ff-8024290de770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:00.011163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861af4d6-930e-4207-a5ff-8024290de770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:00.012644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861af4d6-930e-4207-a5ff-8024290de770 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:00.020577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1165/2357] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:00.107067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121717f4-7cc8-48a9-bd0a-acdf20a4dcc1 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:00.107361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121717f4-7cc8-48a9-bd0a-acdf20a4dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:00.107648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121717f4-7cc8-48a9-bd0a-acdf20a4dcc1 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:00.109008 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1193/2358] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 22 12:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:53:00.114137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e068-9a99-4f6d-baec-9af36360b9c5 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:00.114453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e068-9a99-4f6d-baec-9af36360b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:00.114755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e068-9a99-4f6d-baec-9af36360b9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:00.135833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-4583e068-9a99-4f6d-baec-9af36360b9c5 None None] MFA Rules not processed for user `9e2f71ebeca2441791a0241de737cad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:00.137120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-4583e068-9a99-4f6d-baec-9af36360b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:00.146402 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1166/2359] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 22 12:53:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:00.156888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121717f4-7cc8-48a9-bd0a-acdf20a4dcc1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:00.158711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-121717f4-7cc8-48a9-bd0a-acdf20a4dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:00.172230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121717f4-7cc8-48a9-bd0a-acdf20a4dcc1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:00.176406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4254-2830-41f3-b601-6c281b490409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:00.176690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4254-2830-41f3-b601-6c281b490409 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:00.177030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4254-2830-41f3-b601-6c281b490409 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:00.177314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4254-2830-41f3-b601-6c281b490409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:00.188782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec4254-2830-41f3-b601-6c281b490409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:00.190261 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec4254-2830-41f3-b601-6c281b490409 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:00.202118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1194/2360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:02.285595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e068-9a99-4f6d-baec-9af36360b9c5 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:02.352484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:02.387870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e068-9a99-4f6d-baec-9af36360b9c5 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:02.392821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:02.393524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:02.393948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:02.394454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] PATH_INFO: `/v3/users/25bb864c113f4bf590eaff6e5db6f760` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:02.396208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bb864c113f4bf590eaff6e5db6f760)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:02.399237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:02.705551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bb864c113f4bf590eaff6e5db6f760'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:02.740160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bb864c113f4bf590eaff6e5db6f760'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:02.833003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bb864c113f4bf590eaff6e5db6f760'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:02.842818 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bb864c113f4bf590eaff6e5db6f760'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:02.843675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bb864c113f4bf590eaff6e5db6f760'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:02.850224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1167/2361] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:02 2022] DELETE /identity/v3/users/25bb864c113f4bf590eaff6e5db6f760 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:02.854970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f8e2-1cc0-4085-af2a-5fdb24b1e70f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:02.855479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f8e2-1cc0-4085-af2a-5fdb24b1e70f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:02.855565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f8e2-1cc0-4085-af2a-5fdb24b1e70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:02.884847 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-eab8f8e2-1cc0-4085-af2a-5fdb24b1e70f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:02.885989 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-eab8f8e2-1cc0-4085-af2a-5fdb24b1e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:02.920240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:02.952529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1195/2362] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:02.959657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:02.961152 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:03.059767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81f6f-af2b-45ea-ac6c-ce6b5b9e7508 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:03.063513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847545b-2fe1-494d-aa4c-f0f2789548a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:03.064129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847545b-2fe1-494d-aa4c-f0f2789548a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:03.064413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847545b-2fe1-494d-aa4c-f0f2789548a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:03.064688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847545b-2fe1-494d-aa4c-f0f2789548a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:03.076489 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847545b-2fe1-494d-aa4c-f0f2789548a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:03.078148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847545b-2fe1-494d-aa4c-f0f2789548a7 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:03.088659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1168/2363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:03.313800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8f8e2-1cc0-4085-af2a-5fdb24b1e70f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:03.316036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-eab8f8e2-1cc0-4085-af2a-5fdb24b1e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:03.430910 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8f8e2-1cc0-4085-af2a-5fdb24b1e70f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:03.438696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671058b-dd1a-4712-b461-44a92c4f67a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:03.440017 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671058b-dd1a-4712-b461-44a92c4f67a5 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:03.441430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671058b-dd1a-4712-b461-44a92c4f67a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:03.442533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671058b-dd1a-4712-b461-44a92c4f67a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:03.451059 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4671058b-dd1a-4712-b461-44a92c4f67a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:03.483453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671058b-dd1a-4712-b461-44a92c4f67a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:03.488483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671058b-dd1a-4712-b461-44a92c4f67a5 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:03.502125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1196/2364] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:03.556743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e2023-389e-4d94-8a82-ff9b298a8455 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:03.557266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e2023-389e-4d94-8a82-ff9b298a8455 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:03.557364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e2023-389e-4d94-8a82-ff9b298a8455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:03.598957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-916e2023-389e-4d94-8a82-ff9b298a8455 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:03.600198 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-916e2023-389e-4d94-8a82-ff9b298a8455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:03.706941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:03.740044 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1169/2365] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:03.752914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671058b-dd1a-4712-b461-44a92c4f67a5 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:03.754547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4671058b-dd1a-4712-b461-44a92c4f67a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:03.836865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e2023-389e-4d94-8a82-ff9b298a8455 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:03.838319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-916e2023-389e-4d94-8a82-ff9b298a8455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:03.863467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e2023-389e-4d94-8a82-ff9b298a8455 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:03.868893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:03.869543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:03.869825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:03.870117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] PATH_INFO: `/v3/projects/6f913534ae9c46abb2781a1cb2c73f3f` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:03.871278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f913534ae9c46abb2781a1cb2c73f3f)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:03.873284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:03.917685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671058b-dd1a-4712-b461-44a92c4f67a5 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:03.923914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab94b0-5932-4a98-807a-d1838ab020de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:03.925062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab94b0-5932-4a98-807a-d1838ab020de service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:03.925434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab94b0-5932-4a98-807a-d1838ab020de service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:03.925837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab94b0-5932-4a98-807a-d1838ab020de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:03.936666 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab94b0-5932-4a98-807a-d1838ab020de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:03.939043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab94b0-5932-4a98-807a-d1838ab020de service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:03.948935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1197/2366] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:53:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:53:03.988829 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f913534ae9c46abb2781a1cb2c73f3f', 'request_id': 'req-24fd0515-ca00-4858-a81c-75e9dfa9f64f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:04.076781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f913534ae9c46abb2781a1cb2c73f3f', 'request_id': 'req-24fd0515-ca00-4858-a81c-75e9dfa9f64f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:04.084504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f913534ae9c46abb2781a1cb2c73f3f', 'request_id': 'req-24fd0515-ca00-4858-a81c-75e9dfa9f64f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:04.098861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] The token cache is being invalidate because project 6f913534ae9c46abb2781a1cb2c73f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:04.099149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:04.099962 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:04.104736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1170/2367] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:03 2022] DELETE /identity/v3/projects/6f913534ae9c46abb2781a1cb2c73f3f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:04.106083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab94b0-5932-4a98-807a-d1838ab020de service swift] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:04.122772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab94b0-5932-4a98-807a-d1838ab020de service swift] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:04.209032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:04.227659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:04.229381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:04.230504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:04.230896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] PATH_INFO: `/v3/users/2eaf094284c84bc18cbd3e02d9bcae29` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:04.233353 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eaf094284c84bc18cbd3e02d9bcae29)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:04.242907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:04.481397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eaf094284c84bc18cbd3e02d9bcae29'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:04.482543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eaf094284c84bc18cbd3e02d9bcae29'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:04.496680 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eaf094284c84bc18cbd3e02d9bcae29'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:04.512578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eaf094284c84bc18cbd3e02d9bcae29'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:04.598678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eaf094284c84bc18cbd3e02d9bcae29'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:04.615690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1198/2368] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:04 2022] DELETE /identity/v3/users/2eaf094284c84bc18cbd3e02d9bcae29 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:05.294305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:05.295285 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:05.334563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd0515-ca00-4858-a81c-75e9dfa9f64f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:05.424385 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:05.425119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:05.425584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:05.426068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] PATH_INFO: `/v3/projects/5a7e22f9a2b84296a9eee5113dedd6cf` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:05.427666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7e22f9a2b84296a9eee5113dedd6cf)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:05.431101 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:05.590294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7e22f9a2b84296a9eee5113dedd6cf', 'request_id': 'req-7fc01bc4-726a-48ab-8b43-9789ba230552'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:05.697991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7e22f9a2b84296a9eee5113dedd6cf', 'request_id': 'req-7fc01bc4-726a-48ab-8b43-9789ba230552'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:05.705918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7e22f9a2b84296a9eee5113dedd6cf', 'request_id': 'req-7fc01bc4-726a-48ab-8b43-9789ba230552'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:05.728493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] The token cache is being invalidate because project 5a7e22f9a2b84296a9eee5113dedd6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:05.729069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:05.734939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:05.740676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1171/2369] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:05 2022] DELETE /identity/v3/projects/5a7e22f9a2b84296a9eee5113dedd6cf => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:05.741227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:05.744258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:05.759636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cbadb-fb35-4bcf-a25b-c89e20b0b37f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:05.824714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:05.825637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:05.826084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:05.827149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] PATH_INFO: `/v3/users/9efad03dba5a440abb48805d549f575e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:05.828531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efad03dba5a440abb48805d549f575e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:05.831117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:06.024904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efad03dba5a440abb48805d549f575e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:06.025781 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efad03dba5a440abb48805d549f575e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:06.033660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efad03dba5a440abb48805d549f575e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:06.047653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efad03dba5a440abb48805d549f575e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:06.049499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:06.112944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-021107a9-7e9b-4971-b11c-c1b8c669f48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efad03dba5a440abb48805d549f575e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:06.121017 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1199/2370] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:05 2022] DELETE /identity/v3/users/9efad03dba5a440abb48805d549f575e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:06.763865 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:06.765524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:06.785006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc01bc4-726a-48ab-8b43-9789ba230552 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:06.811374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:06.867965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:06.869323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:06.869601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:06.869873 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] PATH_INFO: `/v3/projects/1f954670380b48a191fa2ec5fa941bd1` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:06.871066 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f954670380b48a191fa2ec5fa941bd1)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:06.872995 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:07.009588 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f954670380b48a191fa2ec5fa941bd1', 'request_id': 'req-d6d1a8e2-b3b8-4317-8034-729241c72030'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:07.105147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f954670380b48a191fa2ec5fa941bd1', 'request_id': 'req-d6d1a8e2-b3b8-4317-8034-729241c72030'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:07.116327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f954670380b48a191fa2ec5fa941bd1', 'request_id': 'req-d6d1a8e2-b3b8-4317-8034-729241c72030'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:07.135768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] The token cache is being invalidate because project 1f954670380b48a191fa2ec5fa941bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:07.136183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:07.136997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d6d1a8e2-b3b8-4317-8034-729241c72030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:07.138716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1172/2371] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:06 2022] DELETE /identity/v3/projects/1f954670380b48a191fa2ec5fa941bd1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:07.146492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d355b-48cb-404f-b8ec-cdc3a7060ffc None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:07.147142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d355b-48cb-404f-b8ec-cdc3a7060ffc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:07.147142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d355b-48cb-404f-b8ec-cdc3a7060ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:07.169769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c66d355b-48cb-404f-b8ec-cdc3a7060ffc None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:07.170955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c66d355b-48cb-404f-b8ec-cdc3a7060ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:07.245563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1200/2372] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:07.255058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c530131-1537-4058-b78f-916dc3e987b8 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:07.255348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c530131-1537-4058-b78f-916dc3e987b8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:07.255613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c530131-1537-4058-b78f-916dc3e987b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:07.276972 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-4c530131-1537-4058-b78f-916dc3e987b8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:07.278181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-4c530131-1537-4058-b78f-916dc3e987b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:07.285839 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1173/2373] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:07.290299 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d355b-48cb-404f-b8ec-cdc3a7060ffc None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:07.306326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d355b-48cb-404f-b8ec-cdc3a7060ffc None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:07.313385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceec8c4-e6f4-445a-8083-2d042971d2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:07.314587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceec8c4-e6f4-445a-8083-2d042971d2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:07.315047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceec8c4-e6f4-445a-8083-2d042971d2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:07.315500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceec8c4-e6f4-445a-8083-2d042971d2d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:07.316581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceec8c4-e6f4-445a-8083-2d042971d2d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:07.317085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceec8c4-e6f4-445a-8083-2d042971d2d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:07.319946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceec8c4-e6f4-445a-8083-2d042971d2d1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:07.342548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1201/2374] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:07.346524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c530131-1537-4058-b78f-916dc3e987b8 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:07.358862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c530131-1537-4058-b78f-916dc3e987b8 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:07.363924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94d93b-7d2e-4bb7-8dfd-e07b27eb8853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:07.364613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94d93b-7d2e-4bb7-8dfd-e07b27eb8853 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:07.364961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94d93b-7d2e-4bb7-8dfd-e07b27eb8853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:07.365301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94d93b-7d2e-4bb7-8dfd-e07b27eb8853 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:07.366010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94d93b-7d2e-4bb7-8dfd-e07b27eb8853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:07.368776 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94d93b-7d2e-4bb7-8dfd-e07b27eb8853 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:07.470012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1174/2375] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:07 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:07.474288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceec8c4-e6f4-445a-8083-2d042971d2d1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:07.486600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceec8c4-e6f4-445a-8083-2d042971d2d1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:07.576831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcfbcc-20cb-4e6f-8681-bcaaf0784aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:07.579990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcfbcc-20cb-4e6f-8681-bcaaf0784aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:07.580510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcfbcc-20cb-4e6f-8681-bcaaf0784aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:07.580891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcfbcc-20cb-4e6f-8681-bcaaf0784aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:07.582030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcfbcc-20cb-4e6f-8681-bcaaf0784aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:07.583924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcfbcc-20cb-4e6f-8681-bcaaf0784aa2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:07.664425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1202/2376] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:07 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:07.669493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94d93b-7d2e-4bb7-8dfd-e07b27eb8853 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:07.694319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94d93b-7d2e-4bb7-8dfd-e07b27eb8853 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:07.712150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9264b-8768-4ef0-bd19-555e4c30f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:07.715033 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9264b-8768-4ef0-bd19-555e4c30f296 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:07.715468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9264b-8768-4ef0-bd19-555e4c30f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:07.716139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9264b-8768-4ef0-bd19-555e4c30f296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:07.717661 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9264b-8768-4ef0-bd19-555e4c30f296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:07.720231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9264b-8768-4ef0-bd19-555e4c30f296 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:07.751081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1175/2377] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:07.753368 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcfbcc-20cb-4e6f-8681-bcaaf0784aa2 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:07.772338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcfbcc-20cb-4e6f-8681-bcaaf0784aa2 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:07.782064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006bc0f-f5e7-403c-81d8-72f506be777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:07.782802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006bc0f-f5e7-403c-81d8-72f506be777a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:07.783159 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006bc0f-f5e7-403c-81d8-72f506be777a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:07.783507 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006bc0f-f5e7-403c-81d8-72f506be777a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:07.784231 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006bc0f-f5e7-403c-81d8-72f506be777a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:07.786166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006bc0f-f5e7-403c-81d8-72f506be777a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:07.811907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1203/2378] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:07.815631 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9264b-8768-4ef0-bd19-555e4c30f296 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:07.828300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9264b-8768-4ef0-bd19-555e4c30f296 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:07.834521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6420-e27d-470e-a2c3-aa42be270757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:07.835200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6420-e27d-470e-a2c3-aa42be270757 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:07.835485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6420-e27d-470e-a2c3-aa42be270757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:07.835925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6420-e27d-470e-a2c3-aa42be270757 admin admin] PATH_INFO: `/v3/projects/be877bbef1f5429d9f935609a61a5ace/users/8856d34b41464a90b27ad91e4f27204e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:07.863771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb6420-e27d-470e-a2c3-aa42be270757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be877bbef1f5429d9f935609a61a5ace, user_id=8856d34b41464a90b27ad91e4f27204e, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:07.863771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb6420-e27d-470e-a2c3-aa42be270757 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:07.939442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1176/2379] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:07 2022] PUT /identity/v3/projects/be877bbef1f5429d9f935609a61a5ace/users/8856d34b41464a90b27ad91e4f27204e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:07.951304 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f34406-1ad1-45f8-be1a-249b90344377 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:07.951590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f34406-1ad1-45f8-be1a-249b90344377 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:07.951872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f34406-1ad1-45f8-be1a-249b90344377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:07.985497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b1f34406-1ad1-45f8-be1a-249b90344377 None None] MFA Rules not processed for user `8856d34b41464a90b27ad91e4f27204e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:07.986872 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b1f34406-1ad1-45f8-be1a-249b90344377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:08.048586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:08.068909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1204/2380] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:08.077293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6420-e27d-470e-a2c3-aa42be270757 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:08.125214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:08.148874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6420-e27d-470e-a2c3-aa42be270757 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:08.155030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0658ec-8610-4e16-b7c0-e33daa5392ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:08.155753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0658ec-8610-4e16-b7c0-e33daa5392ae admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:08.156874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0658ec-8610-4e16-b7c0-e33daa5392ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:08.157268 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0658ec-8610-4e16-b7c0-e33daa5392ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:08.158983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0658ec-8610-4e16-b7c0-e33daa5392ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:08.162557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0658ec-8610-4e16-b7c0-e33daa5392ae admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:08.320680 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1177/2381] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:08 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:08.322377 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f34406-1ad1-45f8-be1a-249b90344377 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:08.333492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f34406-1ad1-45f8-be1a-249b90344377 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:08.432110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd60de9-20f1-4b0d-9671-7d3962b49c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:08.432820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd60de9-20f1-4b0d-9671-7d3962b49c88 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:08.433173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd60de9-20f1-4b0d-9671-7d3962b49c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:08.433544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd60de9-20f1-4b0d-9671-7d3962b49c88 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:08.434380 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd60de9-20f1-4b0d-9671-7d3962b49c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:08.436427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd60de9-20f1-4b0d-9671-7d3962b49c88 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:08.553769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1205/2382] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:08 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:08.558429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0658ec-8610-4e16-b7c0-e33daa5392ae admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:08.574958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0658ec-8610-4e16-b7c0-e33daa5392ae admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:08.580388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9a95-c4e8-446e-903f-b773d2999013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:08.581188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9a95-c4e8-446e-903f-b773d2999013 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:08.581613 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9a95-c4e8-446e-903f-b773d2999013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:08.582137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9a95-c4e8-446e-903f-b773d2999013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:08.582905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9a95-c4e8-446e-903f-b773d2999013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:08.584593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9a95-c4e8-446e-903f-b773d2999013 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:08.596742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1178/2383] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:08.600971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd60de9-20f1-4b0d-9671-7d3962b49c88 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:08.611688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd60de9-20f1-4b0d-9671-7d3962b49c88 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:08.616191 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc881dfc-9048-4ef4-a168-fc6073ba0c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:08.616876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc881dfc-9048-4ef4-a168-fc6073ba0c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:08.617328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc881dfc-9048-4ef4-a168-fc6073ba0c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:08.617649 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc881dfc-9048-4ef4-a168-fc6073ba0c75 admin admin] PATH_INFO: `/v3/projects/b689c65247f24a5e986fced10dacc40e/users/48c19a3ef3f14d0f8ee7dc46e50419b3/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:08.637880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc881dfc-9048-4ef4-a168-fc6073ba0c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b689c65247f24a5e986fced10dacc40e, user_id=48c19a3ef3f14d0f8ee7dc46e50419b3, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:08.641314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc881dfc-9048-4ef4-a168-fc6073ba0c75 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:08.722366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1206/2384] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:08 2022] PUT /identity/v3/projects/b689c65247f24a5e986fced10dacc40e/users/48c19a3ef3f14d0f8ee7dc46e50419b3/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:08.724494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9a95-c4e8-446e-903f-b773d2999013 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:08.736085 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9a95-c4e8-446e-903f-b773d2999013 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:08.815771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b679da-ec3c-41ff-8fc2-6411bc93dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:08.816629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b679da-ec3c-41ff-8fc2-6411bc93dabf admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:08.816778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b679da-ec3c-41ff-8fc2-6411bc93dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:08.818727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b679da-ec3c-41ff-8fc2-6411bc93dabf admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:08.819744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b679da-ec3c-41ff-8fc2-6411bc93dabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:08.823023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b679da-ec3c-41ff-8fc2-6411bc93dabf admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:08.838582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1179/2385] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:08.842755 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc881dfc-9048-4ef4-a168-fc6073ba0c75 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:08.862979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc881dfc-9048-4ef4-a168-fc6073ba0c75 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:08.872895 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999200b6-c454-4e10-9e12-ff0852d9cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:08.874279 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999200b6-c454-4e10-9e12-ff0852d9cfc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:08.875009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999200b6-c454-4e10-9e12-ff0852d9cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:08.875533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999200b6-c454-4e10-9e12-ff0852d9cfc5 admin admin] PATH_INFO: `/v3/projects/b689c65247f24a5e986fced10dacc40e/users/48c19a3ef3f14d0f8ee7dc46e50419b3/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:08.877658 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999200b6-c454-4e10-9e12-ff0852d9cfc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b689c65247f24a5e986fced10dacc40e, user_id=48c19a3ef3f14d0f8ee7dc46e50419b3, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:08.880827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999200b6-c454-4e10-9e12-ff0852d9cfc5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:08.911456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1207/2386] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:08 2022] PUT /identity/v3/projects/b689c65247f24a5e986fced10dacc40e/users/48c19a3ef3f14d0f8ee7dc46e50419b3/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:08.916232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30aa8ba-a632-40c0-85ba-1652d4841867 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:08.916524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30aa8ba-a632-40c0-85ba-1652d4841867 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:08.916878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30aa8ba-a632-40c0-85ba-1652d4841867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:09.010034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-b30aa8ba-a632-40c0-85ba-1652d4841867 None None] MFA Rules not processed for user `48c19a3ef3f14d0f8ee7dc46e50419b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:09.010340 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b30aa8ba-a632-40c0-85ba-1652d4841867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:09.207851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1180/2387] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:09.220352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999200b6-c454-4e10-9e12-ff0852d9cfc5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:09.222559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-999200b6-c454-4e10-9e12-ff0852d9cfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:09.307084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999200b6-c454-4e10-9e12-ff0852d9cfc5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:09.310917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd46b13-5d85-47d3-bd2d-7a783b59a7f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:09.311559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd46b13-5d85-47d3-bd2d-7a783b59a7f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:09.312466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd46b13-5d85-47d3-bd2d-7a783b59a7f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:09.312466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd46b13-5d85-47d3-bd2d-7a783b59a7f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:09.322983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd46b13-5d85-47d3-bd2d-7a783b59a7f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:09.324579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd46b13-5d85-47d3-bd2d-7a783b59a7f6 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:09.336790 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1208/2388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:09.555994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30aa8ba-a632-40c0-85ba-1652d4841867 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:09.622465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:09.668498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30aa8ba-a632-40c0-85ba-1652d4841867 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:09.672997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:09.673644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:09.673931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:09.674226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] PATH_INFO: `/v3/users/8856d34b41464a90b27ad91e4f27204e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:09.675376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8856d34b41464a90b27ad91e4f27204e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:09.677331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:10.201781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8856d34b41464a90b27ad91e4f27204e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:10.217450 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8856d34b41464a90b27ad91e4f27204e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:10.293483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8856d34b41464a90b27ad91e4f27204e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:10.303271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8856d34b41464a90b27ad91e4f27204e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:10.304185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8856d34b41464a90b27ad91e4f27204e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:10.335386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a668a-dc79-4e52-963b-d3ad681075da None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:10.336637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a668a-dc79-4e52-963b-d3ad681075da None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:10.336637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a668a-dc79-4e52-963b-d3ad681075da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:10.339728 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1181/2389] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:09 2022] DELETE /identity/v3/users/8856d34b41464a90b27ad91e4f27204e => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:10.362703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ec1a668a-dc79-4e52-963b-d3ad681075da None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:10.366470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ec1a668a-dc79-4e52-963b-d3ad681075da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:10.426504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:10.482286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1209/2390] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:10.490246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:10.492064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:10.570326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4cf4d-bee9-47c6-a82f-1f03996cd636 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:10.574463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16f505-806c-4ee4-9f08-db9bcf806ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:10.575193 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16f505-806c-4ee4-9f08-db9bcf806ebc service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:10.575513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16f505-806c-4ee4-9f08-db9bcf806ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:10.575861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16f505-806c-4ee4-9f08-db9bcf806ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:10.596276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16f505-806c-4ee4-9f08-db9bcf806ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:10.597853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16f505-806c-4ee4-9f08-db9bcf806ebc service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:10.609336 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1182/2391] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:11.166889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a668a-dc79-4e52-963b-d3ad681075da None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:11.168513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ec1a668a-dc79-4e52-963b-d3ad681075da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:11.206844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a668a-dc79-4e52-963b-d3ad681075da None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:11.214836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:11.215595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:11.215882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:11.216205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] PATH_INFO: `/v3/projects/be877bbef1f5429d9f935609a61a5ace` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:11.217349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be877bbef1f5429d9f935609a61a5ace)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:11.219361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:11.377077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be877bbef1f5429d9f935609a61a5ace', 'request_id': 'req-396beb02-a3a5-444f-9859-9ca1e3f83232'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.389090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be877bbef1f5429d9f935609a61a5ace', 'request_id': 'req-396beb02-a3a5-444f-9859-9ca1e3f83232'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.465172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be877bbef1f5429d9f935609a61a5ace', 'request_id': 'req-396beb02-a3a5-444f-9859-9ca1e3f83232'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.477828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] The token cache is being invalidate because project be877bbef1f5429d9f935609a61a5ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:11.481882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.481882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.481882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1210/2392] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:11 2022] DELETE /identity/v3/projects/be877bbef1f5429d9f935609a61a5ace => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:11.487569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16f505-806c-4ee4-9f08-db9bcf806ebc service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:11.503257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16f505-806c-4ee4-9f08-db9bcf806ebc service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:11.603319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:11.612736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:11.620482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:11.620482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:11.620482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] PATH_INFO: `/v3/users/48c19a3ef3f14d0f8ee7dc46e50419b3` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:11.620482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c19a3ef3f14d0f8ee7dc46e50419b3)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:11.620482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:11.789546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c19a3ef3f14d0f8ee7dc46e50419b3'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.802464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c19a3ef3f14d0f8ee7dc46e50419b3'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.893878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c19a3ef3f14d0f8ee7dc46e50419b3'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.903123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c19a3ef3f14d0f8ee7dc46e50419b3'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.903832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-74ee892e-bd44-413e-b0e9-ae27f403404f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c19a3ef3f14d0f8ee7dc46e50419b3'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.912725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1183/2393] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:11 2022] DELETE /identity/v3/users/48c19a3ef3f14d0f8ee7dc46e50419b3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:12.428368 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:12.430558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:12.443926 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396beb02-a3a5-444f-9859-9ca1e3f83232 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:12.513985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:12.514673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.515455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.515932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] PATH_INFO: `/v3/projects/b689c65247f24a5e986fced10dacc40e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.517092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b689c65247f24a5e986fced10dacc40e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:12.519444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:12.626986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b689c65247f24a5e986fced10dacc40e', 'request_id': 'req-bff2683d-92b9-4be2-bad9-6d90c59d9522'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:12.633901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b689c65247f24a5e986fced10dacc40e', 'request_id': 'req-bff2683d-92b9-4be2-bad9-6d90c59d9522'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:12.740911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b689c65247f24a5e986fced10dacc40e', 'request_id': 'req-bff2683d-92b9-4be2-bad9-6d90c59d9522'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:12.746884 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:12.754751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] The token cache is being invalidate because project b689c65247f24a5e986fced10dacc40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:12.755044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:12.755689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bff2683d-92b9-4be2-bad9-6d90c59d9522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:12.757370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1211/2394] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:12 2022] DELETE /identity/v3/projects/b689c65247f24a5e986fced10dacc40e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:12.762471 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c3253-4181-4e3b-8380-9801200046f7 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.763014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c3253-4181-4e3b-8380-9801200046f7 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.763014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c3253-4181-4e3b-8380-9801200046f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.783928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c06c3253-4181-4e3b-8380-9801200046f7 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:12.785314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c06c3253-4181-4e3b-8380-9801200046f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:12.853194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1184/2395] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:12.861144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3b3c-1a69-4c3c-aa87-3a91c64f99fa None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.861436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3b3c-1a69-4c3c-aa87-3a91c64f99fa None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.861718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3b3c-1a69-4c3c-aa87-3a91c64f99fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.881952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-75ec3b3c-1a69-4c3c-aa87-3a91c64f99fa None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:12.883466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-75ec3b3c-1a69-4c3c-aa87-3a91c64f99fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:12.892379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1212/2396] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:12.896623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c3253-4181-4e3b-8380-9801200046f7 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:12.906866 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c3253-4181-4e3b-8380-9801200046f7 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:12.911414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db77c22-789f-4979-a811-20f595c948e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:12.912007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db77c22-789f-4979-a811-20f595c948e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.912289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db77c22-789f-4979-a811-20f595c948e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.912563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db77c22-789f-4979-a811-20f595c948e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.913209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db77c22-789f-4979-a811-20f595c948e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:12.913547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db77c22-789f-4979-a811-20f595c948e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:12.915835 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db77c22-789f-4979-a811-20f595c948e5 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:12.927179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1185/2397] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:12.931729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec3b3c-1a69-4c3c-aa87-3a91c64f99fa None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:12.940826 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec3b3c-1a69-4c3c-aa87-3a91c64f99fa None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:12.945523 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c04648-0e41-414b-88e3-7fec07509bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:12.946113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c04648-0e41-414b-88e3-7fec07509bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.946425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c04648-0e41-414b-88e3-7fec07509bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.946701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c04648-0e41-414b-88e3-7fec07509bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.947355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c04648-0e41-414b-88e3-7fec07509bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:12.949611 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c04648-0e41-414b-88e3-7fec07509bc8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:13.028875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1213/2398] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:12 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:13.032975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db77c22-789f-4979-a811-20f595c948e5 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:13.043075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db77c22-789f-4979-a811-20f595c948e5 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:13.099314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f1d92-6486-4b9c-a5d1-d88b6b7445c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:13.099926 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f1d92-6486-4b9c-a5d1-d88b6b7445c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.100292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f1d92-6486-4b9c-a5d1-d88b6b7445c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.100477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f1d92-6486-4b9c-a5d1-d88b6b7445c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.101103 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f1d92-6486-4b9c-a5d1-d88b6b7445c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:13.103468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f1d92-6486-4b9c-a5d1-d88b6b7445c6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:13.112463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:13.204427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1186/2399] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:13 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:13.208525 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c04648-0e41-414b-88e3-7fec07509bc8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:13.220569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c04648-0e41-414b-88e3-7fec07509bc8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:13.227326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9f549-79ab-43e3-9bf8-0a057f96f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:13.227937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f549-79ab-43e3-9bf8-0a057f96f870 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.228221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f549-79ab-43e3-9bf8-0a057f96f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.228499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f549-79ab-43e3-9bf8-0a057f96f870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.229178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9f549-79ab-43e3-9bf8-0a057f96f870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:13.230820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9f549-79ab-43e3-9bf8-0a057f96f870 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:13.243642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1214/2400] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:13.244919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f1d92-6486-4b9c-a5d1-d88b6b7445c6 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:13.255556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f1d92-6486-4b9c-a5d1-d88b6b7445c6 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:13.261013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f771d9-234e-4c42-9047-4ce7149484b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:13.261611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f771d9-234e-4c42-9047-4ce7149484b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.261893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f771d9-234e-4c42-9047-4ce7149484b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.262234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f771d9-234e-4c42-9047-4ce7149484b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.263005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f771d9-234e-4c42-9047-4ce7149484b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:13.264592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f771d9-234e-4c42-9047-4ce7149484b4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:13.276094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1187/2401] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:13.280358 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9f549-79ab-43e3-9bf8-0a057f96f870 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:13.290584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9f549-79ab-43e3-9bf8-0a057f96f870 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:13.295252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7aa676-ed34-4bae-b93b-65a09ffda23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:13.296596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aa676-ed34-4bae-b93b-65a09ffda23e admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.296596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aa676-ed34-4bae-b93b-65a09ffda23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.296596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aa676-ed34-4bae-b93b-65a09ffda23e admin admin] PATH_INFO: `/v3/projects/50b82330a479439385658862983cf351/users/429c0fdb9460465c9c173fe4629eea4d/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.312712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7aa676-ed34-4bae-b93b-65a09ffda23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b82330a479439385658862983cf351, user_id=429c0fdb9460465c9c173fe4629eea4d, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:13.315405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7aa676-ed34-4bae-b93b-65a09ffda23e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:13.442114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1215/2402] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:13 2022] PUT /identity/v3/projects/50b82330a479439385658862983cf351/users/429c0fdb9460465c9c173fe4629eea4d/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:13.453220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8525b3-eafb-4b0c-a1cc-6949b0826930 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.453505 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8525b3-eafb-4b0c-a1cc-6949b0826930 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.453779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8525b3-eafb-4b0c-a1cc-6949b0826930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.481189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5d8525b3-eafb-4b0c-a1cc-6949b0826930 None None] MFA Rules not processed for user `429c0fdb9460465c9c173fe4629eea4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:13.482852 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5d8525b3-eafb-4b0c-a1cc-6949b0826930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:13.548825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1188/2403] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:13.559553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7aa676-ed34-4bae-b93b-65a09ffda23e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:13.561356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6b7aa676-ed34-4bae-b93b-65a09ffda23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:13.621609 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7aa676-ed34-4bae-b93b-65a09ffda23e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:13.626387 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ee5ab-a9de-49e6-92d9-25db8b531a46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e56c9d900f4e4e91ea944d4cb0a40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:13.627388 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ee5ab-a9de-49e6-92d9-25db8b531a46 service glance] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.627966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ee5ab-a9de-49e6-92d9-25db8b531a46 service glance] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.628340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ee5ab-a9de-49e6-92d9-25db8b531a46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.638062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ee5ab-a9de-49e6-92d9-25db8b531a46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:13.639547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ee5ab-a9de-49e6-92d9-25db8b531a46 service glance] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:13.649020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1216/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:16.943779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8525b3-eafb-4b0c-a1cc-6949b0826930 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:16.945329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5d8525b3-eafb-4b0c-a1cc-6949b0826930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:17.076507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8525b3-eafb-4b0c-a1cc-6949b0826930 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:17.090414 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f104d6f-3f09-427b-b79a-6a1cacab5a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:17.091349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104d6f-3f09-427b-b79a-6a1cacab5a79 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:17.091903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104d6f-3f09-427b-b79a-6a1cacab5a79 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:17.092636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104d6f-3f09-427b-b79a-6a1cacab5a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:17.094886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8f104d6f-3f09-427b-b79a-6a1cacab5a79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:17.110300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f104d6f-3f09-427b-b79a-6a1cacab5a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:17.112657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f104d6f-3f09-427b-b79a-6a1cacab5a79 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:17.132283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1189/2405] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:21.836314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ee5ab-a9de-49e6-92d9-25db8b531a46 service glance] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:21.837856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b31ee5ab-a9de-49e6-92d9-25db8b531a46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:21.898986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ee5ab-a9de-49e6-92d9-25db8b531a46 service glance] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:21.902698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80682ebb-77cf-4add-af4c-fd9834e16be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:21.903441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80682ebb-77cf-4add-af4c-fd9834e16be8 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:21.903734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80682ebb-77cf-4add-af4c-fd9834e16be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:21.904014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80682ebb-77cf-4add-af4c-fd9834e16be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:21.905778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-80682ebb-77cf-4add-af4c-fd9834e16be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:21.963397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:21.982740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80682ebb-77cf-4add-af4c-fd9834e16be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:21.984250 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80682ebb-77cf-4add-af4c-fd9834e16be8 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:21.997512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1217/2406] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:22.487026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd4b40-2474-4433-9069-ceeaf5845142 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:22.487548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd4b40-2474-4433-9069-ceeaf5845142 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:22.487633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd4b40-2474-4433-9069-ceeaf5845142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:22.510485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-abfd4b40-2474-4433-9069-ceeaf5845142 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:22.511840 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-abfd4b40-2474-4433-9069-ceeaf5845142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:22.571150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:22.579121 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1190/2407] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 22 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:22.599668 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80682ebb-77cf-4add-af4c-fd9834e16be8 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:22.604356 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-80682ebb-77cf-4add-af4c-fd9834e16be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:22.712505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80682ebb-77cf-4add-af4c-fd9834e16be8 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:22.719439 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0680dc5-832d-4ecf-aab9-0825c8c8108f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:22.723537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0680dc5-832d-4ecf-aab9-0825c8c8108f service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:22.723537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0680dc5-832d-4ecf-aab9-0825c8c8108f service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:22.723537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0680dc5-832d-4ecf-aab9-0825c8c8108f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:22.736227 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0680dc5-832d-4ecf-aab9-0825c8c8108f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:22.737960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0680dc5-832d-4ecf-aab9-0825c8c8108f service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:22.746728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1218/2408] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:53:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:53:24.497109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd4b40-2474-4433-9069-ceeaf5845142 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:24.498879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-abfd4b40-2474-4433-9069-ceeaf5845142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:24.511067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd4b40-2474-4433-9069-ceeaf5845142 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:24.514776 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2890ad4-e207-4c35-989b-b6437dc5c547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:24.515389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2890ad4-e207-4c35-989b-b6437dc5c547 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:24.515671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2890ad4-e207-4c35-989b-b6437dc5c547 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:24.515949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2890ad4-e207-4c35-989b-b6437dc5c547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:24.517917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f2890ad4-e207-4c35-989b-b6437dc5c547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:24.532600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2890ad4-e207-4c35-989b-b6437dc5c547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:24.534355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2890ad4-e207-4c35-989b-b6437dc5c547 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:24.548104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1191/2409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:27.392558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0680dc5-832d-4ecf-aab9-0825c8c8108f service swift] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:27.394129 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f0680dc5-832d-4ecf-aab9-0825c8c8108f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:27.497221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0680dc5-832d-4ecf-aab9-0825c8c8108f service swift] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:27.502627 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10a65e-3bcc-4fbf-9a82-deb69f0ad35e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8495c97df48f18b10039584d52f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:27.503338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10a65e-3bcc-4fbf-9a82-deb69f0ad35e service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:27.503943 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10a65e-3bcc-4fbf-9a82-deb69f0ad35e service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:27.504300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10a65e-3bcc-4fbf-9a82-deb69f0ad35e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:27.506156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6d10a65e-3bcc-4fbf-9a82-deb69f0ad35e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:27.518899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10a65e-3bcc-4fbf-9a82-deb69f0ad35e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:27.520737 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10a65e-3bcc-4fbf-9a82-deb69f0ad35e service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:27.532156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1219/2410] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:27.548109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2890ad4-e207-4c35-989b-b6437dc5c547 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:27.549574 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f2890ad4-e207-4c35-989b-b6437dc5c547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:27.564520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2890ad4-e207-4c35-989b-b6437dc5c547 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:27.571236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:27.572476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:27.574611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:27.574901 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] PATH_INFO: `/v3/users/a26f0791dd7741ae8ff4065dc43f099e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:27.581374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26f0791dd7741ae8ff4065dc43f099e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:27.581374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:27.872305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26f0791dd7741ae8ff4065dc43f099e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:27.885452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26f0791dd7741ae8ff4065dc43f099e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:27.985650 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26f0791dd7741ae8ff4065dc43f099e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:27.996181 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26f0791dd7741ae8ff4065dc43f099e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:27.996913 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0574ebef-e08a-4ff9-b2e2-e421913325be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26f0791dd7741ae8ff4065dc43f099e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:28.003117 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1192/2411] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:27 2022] DELETE /identity/v3/users/a26f0791dd7741ae8ff4065dc43f099e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:28.270928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10a65e-3bcc-4fbf-9a82-deb69f0ad35e service placement] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:28.282889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10a65e-3bcc-4fbf-9a82-deb69f0ad35e service placement] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:28.348195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:28.348842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:28.349123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:28.349587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] PATH_INFO: `/v3/projects/32194c49d249450496ccd0aaf317d9fb` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:28.351695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32194c49d249450496ccd0aaf317d9fb)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:28.353238 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:28.360974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:28.512725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32194c49d249450496ccd0aaf317d9fb', 'request_id': 'req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:28.519631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32194c49d249450496ccd0aaf317d9fb', 'request_id': 'req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:28.638602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32194c49d249450496ccd0aaf317d9fb', 'request_id': 'req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:28.674446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] The token cache is being invalidate because project 32194c49d249450496ccd0aaf317d9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:28.674750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:28.675554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-adb05184-fba3-4a34-ba4e-76e0e6dd8b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:28.677536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1220/2412] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:28 2022] DELETE /identity/v3/projects/32194c49d249450496ccd0aaf317d9fb => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:28.682597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81b67-7948-489c-9826-535ba77d6789 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:28.683089 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81b67-7948-489c-9826-535ba77d6789 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:28.683188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81b67-7948-489c-9826-535ba77d6789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:28.705026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-3ed81b67-7948-489c-9826-535ba77d6789 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:28.706812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3ed81b67-7948-489c-9826-535ba77d6789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:28.779280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1193/2413] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:28.787787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7fa8e-a314-478a-a3be-81fa673ff12c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:28.788084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7fa8e-a314-478a-a3be-81fa673ff12c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:28.788554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7fa8e-a314-478a-a3be-81fa673ff12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:28.809863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1ac7fa8e-a314-478a-a3be-81fa673ff12c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:28.811150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1ac7fa8e-a314-478a-a3be-81fa673ff12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:28.823434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1221/2414] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:28.825112 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed81b67-7948-489c-9826-535ba77d6789 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:28.837552 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed81b67-7948-489c-9826-535ba77d6789 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:28.842726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022e377-faab-44ac-b7e3-5ca2fced64c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:28.843642 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022e377-faab-44ac-b7e3-5ca2fced64c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:28.843923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022e377-faab-44ac-b7e3-5ca2fced64c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:28.844337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022e377-faab-44ac-b7e3-5ca2fced64c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:28.845003 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022e377-faab-44ac-b7e3-5ca2fced64c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:28.845305 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022e377-faab-44ac-b7e3-5ca2fced64c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:28.847036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022e377-faab-44ac-b7e3-5ca2fced64c5 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:28.865027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1194/2415] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:53:28.870114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7fa8e-a314-478a-a3be-81fa673ff12c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:28.883968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7fa8e-a314-478a-a3be-81fa673ff12c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:28.889602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d56aa-e875-4b12-b8f5-2c2eb84ad5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:28.890267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d56aa-e875-4b12-b8f5-2c2eb84ad5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:28.890560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d56aa-e875-4b12-b8f5-2c2eb84ad5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:28.890840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d56aa-e875-4b12-b8f5-2c2eb84ad5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:28.891481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d56aa-e875-4b12-b8f5-2c2eb84ad5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:28.893428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d56aa-e875-4b12-b8f5-2c2eb84ad5a9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:28.989948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1222/2416] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:28 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:28.991430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022e377-faab-44ac-b7e3-5ca2fced64c5 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:29.002228 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022e377-faab-44ac-b7e3-5ca2fced64c5 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:29.047240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:29.066582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b13ee-a201-4f87-98dc-709c47cb3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:29.066582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b13ee-a201-4f87-98dc-709c47cb3ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:29.066582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b13ee-a201-4f87-98dc-709c47cb3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:29.066582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b13ee-a201-4f87-98dc-709c47cb3ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:29.067257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b13ee-a201-4f87-98dc-709c47cb3ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:29.067257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b13ee-a201-4f87-98dc-709c47cb3ba6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:29.228226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1195/2417] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:28 2022] POST /identity/v3/users => generated 284 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:29.232529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d56aa-e875-4b12-b8f5-2c2eb84ad5a9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:29.243347 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d56aa-e875-4b12-b8f5-2c2eb84ad5a9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:29.248068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b97fc-3af4-427e-ba49-6ab35beb18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:29.248708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b97fc-3af4-427e-ba49-6ab35beb18ad admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:29.248992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b97fc-3af4-427e-ba49-6ab35beb18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:29.249264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b97fc-3af4-427e-ba49-6ab35beb18ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:29.249903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b97fc-3af4-427e-ba49-6ab35beb18ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:29.251600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b97fc-3af4-427e-ba49-6ab35beb18ad admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:29.262614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1223/2418] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:29.276749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b13ee-a201-4f87-98dc-709c47cb3ba6 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:29.286932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b13ee-a201-4f87-98dc-709c47cb3ba6 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:29.292870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7990b-f413-4786-aec0-ec41e898d734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:29.293740 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7990b-f413-4786-aec0-ec41e898d734 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:29.294089 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7990b-f413-4786-aec0-ec41e898d734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:29.294456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7990b-f413-4786-aec0-ec41e898d734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:29.295307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7990b-f413-4786-aec0-ec41e898d734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:29.296998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7990b-f413-4786-aec0-ec41e898d734 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:29.309504 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1196/2419] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:29.315934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b97fc-3af4-427e-ba49-6ab35beb18ad admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:29.333325 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b97fc-3af4-427e-ba49-6ab35beb18ad admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:29.338615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d705d7-0544-492b-a3f2-974427f9c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:29.339407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d705d7-0544-492b-a3f2-974427f9c3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:29.339695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d705d7-0544-492b-a3f2-974427f9c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:29.340370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d705d7-0544-492b-a3f2-974427f9c3f7 admin admin] PATH_INFO: `/v3/projects/d7ce1780f0794b95b66ee5a05b79a015/users/4e9f7f23e91d44cf812bcd36b5686295/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:29.356076 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d705d7-0544-492b-a3f2-974427f9c3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ce1780f0794b95b66ee5a05b79a015, user_id=4e9f7f23e91d44cf812bcd36b5686295, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:29.358803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d705d7-0544-492b-a3f2-974427f9c3f7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:29.450958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7990b-f413-4786-aec0-ec41e898d734 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:29.452687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-80b7990b-f413-4786-aec0-ec41e898d734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:29.466682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7990b-f413-4786-aec0-ec41e898d734 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:29.471803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:29.472247 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:29.472529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:29.472803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] PATH_INFO: `/v3/users/4489cb4f8ec144468b8308ba0a809539` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:29.473935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4489cb4f8ec144468b8308ba0a809539)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:29.475904 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:29.503211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1224/2420] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:29 2022] PUT /identity/v3/projects/d7ce1780f0794b95b66ee5a05b79a015/users/4e9f7f23e91d44cf812bcd36b5686295/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:29.515651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d84f-79ff-412f-80bb-b001106a5d00 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:29.516299 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d84f-79ff-412f-80bb-b001106a5d00 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:29.516299 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d84f-79ff-412f-80bb-b001106a5d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:29.544133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9a35d84f-79ff-412f-80bb-b001106a5d00 None None] MFA Rules not processed for user `4e9f7f23e91d44cf812bcd36b5686295`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:29.545370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9a35d84f-79ff-412f-80bb-b001106a5d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:29.610242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1225/2421] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:29.614830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35d84f-79ff-412f-80bb-b001106a5d00 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:29.635631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:29.675836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35d84f-79ff-412f-80bb-b001106a5d00 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:29.680705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a75d6b-ea14-41ae-a312-f0d01554ea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:29.681310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75d6b-ea14-41ae-a312-f0d01554ea20 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:29.681608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75d6b-ea14-41ae-a312-f0d01554ea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:29.681885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75d6b-ea14-41ae-a312-f0d01554ea20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:29.682553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75d6b-ea14-41ae-a312-f0d01554ea20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:29.684515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75d6b-ea14-41ae-a312-f0d01554ea20 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:29.716358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4489cb4f8ec144468b8308ba0a809539'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:29.727954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4489cb4f8ec144468b8308ba0a809539'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:29.813515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4489cb4f8ec144468b8308ba0a809539'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:29.821542 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1226/2422] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:29 2022] POST /identity/v3/projects => generated 369 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:29.821787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4489cb4f8ec144468b8308ba0a809539'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:29.822473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4489cb4f8ec144468b8308ba0a809539'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:29.825732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a75d6b-ea14-41ae-a312-f0d01554ea20 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:29.827369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-48a75d6b-ea14-41ae-a312-f0d01554ea20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:29.828754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1197/2423] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:29 2022] DELETE /identity/v3/users/4489cb4f8ec144468b8308ba0a809539 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:29.895795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a75d6b-ea14-41ae-a312-f0d01554ea20 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:29.953370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b420f2-b948-473e-a44c-6d21d62fb1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:29.953986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b420f2-b948-473e-a44c-6d21d62fb1ef admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:29.954303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b420f2-b948-473e-a44c-6d21d62fb1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:29.954610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b420f2-b948-473e-a44c-6d21d62fb1ef admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:29.955293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b420f2-b948-473e-a44c-6d21d62fb1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:29.957371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b420f2-b948-473e-a44c-6d21d62fb1ef admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.044928 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1227/2424] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:29 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:30.048801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.058918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ee161-2a1c-459d-a824-4ac514764abd admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.063482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6179f8c-abc0-44b0-8d20-477c9f1c9d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.064126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6179f8c-abc0-44b0-8d20-477c9f1c9d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.064357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6179f8c-abc0-44b0-8d20-477c9f1c9d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.064651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6179f8c-abc0-44b0-8d20-477c9f1c9d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.065274 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6179f8c-abc0-44b0-8d20-477c9f1c9d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.066919 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6179f8c-abc0-44b0-8d20-477c9f1c9d84 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.076938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1198/2425] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:30.081022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b420f2-b948-473e-a44c-6d21d62fb1ef admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.091749 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b420f2-b948-473e-a44c-6d21d62fb1ef admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.096396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e114df8-3698-44e2-a45e-dd55d5cbc6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.097030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114df8-3698-44e2-a45e-dd55d5cbc6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.097311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114df8-3698-44e2-a45e-dd55d5cbc6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.097584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114df8-3698-44e2-a45e-dd55d5cbc6bc admin admin] PATH_INFO: `/v3/projects/9c2fa14ceffe4aab9fa9cff699eb01dd/users/f748970aeb64491786f4dc30cbac445e/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.104317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6179f8c-abc0-44b0-8d20-477c9f1c9d84 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.106559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f6179f8c-abc0-44b0-8d20-477c9f1c9d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:30.115354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e114df8-3698-44e2-a45e-dd55d5cbc6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2fa14ceffe4aab9fa9cff699eb01dd, user_id=f748970aeb64491786f4dc30cbac445e, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.118513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e114df8-3698-44e2-a45e-dd55d5cbc6bc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.121501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6179f8c-abc0-44b0-8d20-477c9f1c9d84 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.126226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.126870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.127156 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.127435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] PATH_INFO: `/v3/projects/012dceb950a2419ab122e8cba66095fa` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.128596 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=012dceb950a2419ab122e8cba66095fa)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.130567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.227371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1228/2426] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:30 2022] PUT /identity/v3/projects/9c2fa14ceffe4aab9fa9cff699eb01dd/users/f748970aeb64491786f4dc30cbac445e/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:30.231181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e114df8-3698-44e2-a45e-dd55d5cbc6bc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.251151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:30.254476 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012dceb950a2419ab122e8cba66095fa', 'request_id': 'req-26020ead-7db4-4dd4-a06e-4dd246a85691'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:30.295392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e114df8-3698-44e2-a45e-dd55d5cbc6bc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.335093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012dceb950a2419ab122e8cba66095fa', 'request_id': 'req-26020ead-7db4-4dd4-a06e-4dd246a85691'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:30.342555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012dceb950a2419ab122e8cba66095fa', 'request_id': 'req-26020ead-7db4-4dd4-a06e-4dd246a85691'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:30.354621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaf125-5a4a-4a21-91b1-28c278f3a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.354874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] The token cache is being invalidate because project 012dceb950a2419ab122e8cba66095fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:30.355169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:30.355276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaf125-5a4a-4a21-91b1-28c278f3a0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.355499 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaf125-5a4a-4a21-91b1-28c278f3a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.355775 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaf125-5a4a-4a21-91b1-28c278f3a0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.355897 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-26020ead-7db4-4dd4-a06e-4dd246a85691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:30.356516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaf125-5a4a-4a21-91b1-28c278f3a0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.357378 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1199/2427] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:30 2022] DELETE /identity/v3/projects/012dceb950a2419ab122e8cba66095fa => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:30.358118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaf125-5a4a-4a21-91b1-28c278f3a0f0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.362034 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016614d-8120-4366-809e-aaf91915c687 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.362378 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016614d-8120-4366-809e-aaf91915c687 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.362657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016614d-8120-4366-809e-aaf91915c687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.373704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1229/2428] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:30.374679 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaf125-5a4a-4a21-91b1-28c278f3a0f0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.378875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9faaf125-5a4a-4a21-91b1-28c278f3a0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:30.384190 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1016614d-8120-4366-809e-aaf91915c687 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:30.385420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1016614d-8120-4366-809e-aaf91915c687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:30.389625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaf125-5a4a-4a21-91b1-28c278f3a0f0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.393494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1200/2429] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:30.394432 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14427efb-873e-46d9-bd49-f3944d270932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.395082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14427efb-873e-46d9-bd49-f3944d270932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.395365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14427efb-873e-46d9-bd49-f3944d270932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.395644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14427efb-873e-46d9-bd49-f3944d270932 admin admin] PATH_INFO: `/v3/projects/9c2fa14ceffe4aab9fa9cff699eb01dd/users/f748970aeb64491786f4dc30cbac445e/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.398059 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14427efb-873e-46d9-bd49-f3944d270932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2fa14ceffe4aab9fa9cff699eb01dd, user_id=f748970aeb64491786f4dc30cbac445e, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.401319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14427efb-873e-46d9-bd49-f3944d270932 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.402948 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f667afe-d776-444d-aff4-652b50ead1bb None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.403239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f667afe-d776-444d-aff4-652b50ead1bb None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.403525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f667afe-d776-444d-aff4-652b50ead1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.411387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:30.412212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1230/2430] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:30 2022] PUT /identity/v3/projects/9c2fa14ceffe4aab9fa9cff699eb01dd/users/f748970aeb64491786f4dc30cbac445e/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:30.423576 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a857a7-1f40-47b7-a044-41cee5e869d0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.423867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a857a7-1f40-47b7-a044-41cee5e869d0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.424157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a857a7-1f40-47b7-a044-41cee5e869d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.425124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5f667afe-d776-444d-aff4-652b50ead1bb None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:30.426427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5f667afe-d776-444d-aff4-652b50ead1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:30.454919 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-59a857a7-1f40-47b7-a044-41cee5e869d0 None None] MFA Rules not processed for user `f748970aeb64491786f4dc30cbac445e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:30.456134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-59a857a7-1f40-47b7-a044-41cee5e869d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:30.488457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1201/2431] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:30.493393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f667afe-d776-444d-aff4-652b50ead1bb None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.505635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f667afe-d776-444d-aff4-652b50ead1bb None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.511448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d51256-bd36-4f3a-ab23-5d9f531f2a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.512106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d51256-bd36-4f3a-ab23-5d9f531f2a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.512388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d51256-bd36-4f3a-ab23-5d9f531f2a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.512667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d51256-bd36-4f3a-ab23-5d9f531f2a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.513344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d51256-bd36-4f3a-ab23-5d9f531f2a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:30.513652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d51256-bd36-4f3a-ab23-5d9f531f2a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.515286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d51256-bd36-4f3a-ab23-5d9f531f2a33 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.527871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1202/2432] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:53:30.532048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d51256-bd36-4f3a-ab23-5d9f531f2a33 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.538804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1231/2433] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:30.547016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d51256-bd36-4f3a-ab23-5d9f531f2a33 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.550093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a857a7-1f40-47b7-a044-41cee5e869d0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.551658 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-59a857a7-1f40-47b7-a044-41cee5e869d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:30.551980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff196b9-0968-44d4-9c65-342a270c325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.552619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff196b9-0968-44d4-9c65-342a270c325a admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.552947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff196b9-0968-44d4-9c65-342a270c325a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.553174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff196b9-0968-44d4-9c65-342a270c325a admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.553802 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff196b9-0968-44d4-9c65-342a270c325a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.556043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff196b9-0968-44d4-9c65-342a270c325a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.589405 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:30.611537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a857a7-1f40-47b7-a044-41cee5e869d0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.615296 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36841cf1-456e-445e-ba70-6db8c0ca5929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.615916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36841cf1-456e-445e-ba70-6db8c0ca5929 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.616207 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36841cf1-456e-445e-ba70-6db8c0ca5929 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.616505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36841cf1-456e-445e-ba70-6db8c0ca5929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.626318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36841cf1-456e-445e-ba70-6db8c0ca5929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.627792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36841cf1-456e-445e-ba70-6db8c0ca5929 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.638231 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1232/2434] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:53:30.684610 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1203/2435] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:30 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:30.688849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36841cf1-456e-445e-ba70-6db8c0ca5929 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.699885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36841cf1-456e-445e-ba70-6db8c0ca5929 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.757205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d9f03-c643-4645-afac-e11448a36e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.765122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9f03-c643-4645-afac-e11448a36e8a admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.765122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9f03-c643-4645-afac-e11448a36e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.765122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9f03-c643-4645-afac-e11448a36e8a admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.765122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d9f03-c643-4645-afac-e11448a36e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.765122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d9f03-c643-4645-afac-e11448a36e8a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.856442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1233/2436] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:30 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:30.857673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff196b9-0968-44d4-9c65-342a270c325a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.869366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff196b9-0968-44d4-9c65-342a270c325a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.879886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ab3f8-e1e3-45ff-b8ae-8d59892cc061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.879886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ab3f8-e1e3-45ff-b8ae-8d59892cc061 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.879886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ab3f8-e1e3-45ff-b8ae-8d59892cc061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.879886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ab3f8-e1e3-45ff-b8ae-8d59892cc061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.880291 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ab3f8-e1e3-45ff-b8ae-8d59892cc061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.880291 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ab3f8-e1e3-45ff-b8ae-8d59892cc061 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.888642 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1204/2437] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:30.892801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d9f03-c643-4645-afac-e11448a36e8a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.902912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d9f03-c643-4645-afac-e11448a36e8a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.908062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12272d7f-e8cc-4e51-ba0d-069ae10706d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.908672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12272d7f-e8cc-4e51-ba0d-069ae10706d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.908960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12272d7f-e8cc-4e51-ba0d-069ae10706d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.909235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12272d7f-e8cc-4e51-ba0d-069ae10706d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.909886 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12272d7f-e8cc-4e51-ba0d-069ae10706d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.911521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12272d7f-e8cc-4e51-ba0d-069ae10706d4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:30.922719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1234/2438] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:30.926656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ab3f8-e1e3-45ff-b8ae-8d59892cc061 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:30.937358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ab3f8-e1e3-45ff-b8ae-8d59892cc061 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:30.942092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d5f49-3f5f-4731-85ec-0acf141ffe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:30.942775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d5f49-3f5f-4731-85ec-0acf141ffe28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:30.943060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d5f49-3f5f-4731-85ec-0acf141ffe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:30.943341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d5f49-3f5f-4731-85ec-0acf141ffe28 admin admin] PATH_INFO: `/v3/projects/908559ec7b9f4752aebc671361f08374/users/0ddb6e3841094efda7c3c332791d4d5a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:30.958614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d5f49-3f5f-4731-85ec-0acf141ffe28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908559ec7b9f4752aebc671361f08374, user_id=0ddb6e3841094efda7c3c332791d4d5a, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:30.961348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d5f49-3f5f-4731-85ec-0acf141ffe28 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:31.073805 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1205/2439] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:30 2022] PUT /identity/v3/projects/908559ec7b9f4752aebc671361f08374/users/0ddb6e3841094efda7c3c332791d4d5a/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:31.086728 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243acbc-05b4-46f3-a054-5b33ab3c7b22 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:31.087022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243acbc-05b4-46f3-a054-5b33ab3c7b22 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:31.087300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243acbc-05b4-46f3-a054-5b33ab3c7b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:31.116623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e243acbc-05b4-46f3-a054-5b33ab3c7b22 None None] MFA Rules not processed for user `0ddb6e3841094efda7c3c332791d4d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:31.118458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e243acbc-05b4-46f3-a054-5b33ab3c7b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:31.186354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1235/2440] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:31.190511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d5f49-3f5f-4731-85ec-0acf141ffe28 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:31.256423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d5f49-3f5f-4731-85ec-0acf141ffe28 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:31.261728 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289d33-e43e-48b6-86ae-e4d6d81592b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:31.262379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289d33-e43e-48b6-86ae-e4d6d81592b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:31.262666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289d33-e43e-48b6-86ae-e4d6d81592b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:31.262944 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289d33-e43e-48b6-86ae-e4d6d81592b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:31.263579 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289d33-e43e-48b6-86ae-e4d6d81592b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:31.265509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289d33-e43e-48b6-86ae-e4d6d81592b9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:31.406331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1206/2441] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:31 2022] POST /identity/v3/projects => generated 369 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:31.412474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243acbc-05b4-46f3-a054-5b33ab3c7b22 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:31.421425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243acbc-05b4-46f3-a054-5b33ab3c7b22 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:31.463580 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:31.478775 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47ba10-3de8-42f2-b77c-674a7b2b35cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:31.479393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47ba10-3de8-42f2-b77c-674a7b2b35cf admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:31.479717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47ba10-3de8-42f2-b77c-674a7b2b35cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:31.481199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47ba10-3de8-42f2-b77c-674a7b2b35cf admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:31.481199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47ba10-3de8-42f2-b77c-674a7b2b35cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:31.482733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47ba10-3de8-42f2-b77c-674a7b2b35cf admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:31.581144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1236/2442] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:31 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:31.585196 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289d33-e43e-48b6-86ae-e4d6d81592b9 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:31.596014 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289d33-e43e-48b6-86ae-e4d6d81592b9 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:31.600681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324fd98-d257-4a05-9754-00dc8ca5e453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:31.601327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324fd98-d257-4a05-9754-00dc8ca5e453 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:31.601804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324fd98-d257-4a05-9754-00dc8ca5e453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:31.602184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324fd98-d257-4a05-9754-00dc8ca5e453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:31.602860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324fd98-d257-4a05-9754-00dc8ca5e453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:31.607385 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324fd98-d257-4a05-9754-00dc8ca5e453 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:31.614964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1207/2443] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:31.619756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47ba10-3de8-42f2-b77c-674a7b2b35cf admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:31.629795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47ba10-3de8-42f2-b77c-674a7b2b35cf admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:31.635830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a91e-a3fe-4474-ac55-0ff3c0a96a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:31.636478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a91e-a3fe-4474-ac55-0ff3c0a96a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:31.636762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a91e-a3fe-4474-ac55-0ff3c0a96a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:31.637040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a91e-a3fe-4474-ac55-0ff3c0a96a5a admin admin] PATH_INFO: `/v3/projects/479aac34b55846a4bbf175784bcaf4e1/users/4eec91b5cda84d88bc4633f2b5e4c984/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:31.651678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225a91e-a3fe-4474-ac55-0ff3c0a96a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=479aac34b55846a4bbf175784bcaf4e1, user_id=4eec91b5cda84d88bc4633f2b5e4c984, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:31.654463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225a91e-a3fe-4474-ac55-0ff3c0a96a5a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:31.747434 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1237/2444] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:31 2022] PUT /identity/v3/projects/479aac34b55846a4bbf175784bcaf4e1/users/4eec91b5cda84d88bc4633f2b5e4c984/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:31.751715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324fd98-d257-4a05-9754-00dc8ca5e453 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:31.761880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324fd98-d257-4a05-9754-00dc8ca5e453 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:31.765598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:31.817908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be396c-d41e-43dc-89e3-e77ed4627ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:31.818552 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be396c-d41e-43dc-89e3-e77ed4627ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:31.819109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be396c-d41e-43dc-89e3-e77ed4627ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:31.819393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be396c-d41e-43dc-89e3-e77ed4627ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:31.820084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be396c-d41e-43dc-89e3-e77ed4627ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:31.821676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be396c-d41e-43dc-89e3-e77ed4627ed1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:31.832212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1208/2445] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:31.836782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a91e-a3fe-4474-ac55-0ff3c0a96a5a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:31.847318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a91e-a3fe-4474-ac55-0ff3c0a96a5a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:31.853164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4a8d0-17e4-4334-8dbc-7534e75b8412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:31.853883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4a8d0-17e4-4334-8dbc-7534e75b8412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:31.854170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4a8d0-17e4-4334-8dbc-7534e75b8412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:31.854477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4a8d0-17e4-4334-8dbc-7534e75b8412 admin admin] PATH_INFO: `/v3/projects/479aac34b55846a4bbf175784bcaf4e1/users/4eec91b5cda84d88bc4633f2b5e4c984/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:31.856483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4a8d0-17e4-4334-8dbc-7534e75b8412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479aac34b55846a4bbf175784bcaf4e1, user_id=4eec91b5cda84d88bc4633f2b5e4c984, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:31.859215 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4a8d0-17e4-4334-8dbc-7534e75b8412 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:31.871186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1238/2446] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:31 2022] PUT /identity/v3/projects/479aac34b55846a4bbf175784bcaf4e1/users/4eec91b5cda84d88bc4633f2b5e4c984/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:31.883184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d171b2-2b75-4f27-8da0-03d57d18fa71 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:31.888902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d171b2-2b75-4f27-8da0-03d57d18fa71 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:31.889264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d171b2-2b75-4f27-8da0-03d57d18fa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:31.919385 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-76d171b2-2b75-4f27-8da0-03d57d18fa71 None None] MFA Rules not processed for user `4eec91b5cda84d88bc4633f2b5e4c984`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:31.920615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-76d171b2-2b75-4f27-8da0-03d57d18fa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:31.989130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1209/2447] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:32.001223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4a8d0-17e4-4334-8dbc-7534e75b8412 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:32.002909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-08f4a8d0-17e4-4334-8dbc-7534e75b8412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:32.068955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4a8d0-17e4-4334-8dbc-7534e75b8412 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:32.072813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa508a-dc80-4374-985c-926f2dfce79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:32.073417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa508a-dc80-4374-985c-926f2dfce79c service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:32.073697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa508a-dc80-4374-985c-926f2dfce79c service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:32.073968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa508a-dc80-4374-985c-926f2dfce79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:32.082737 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa508a-dc80-4374-985c-926f2dfce79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:32.084165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa508a-dc80-4374-985c-926f2dfce79c service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:32.094291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1239/2448] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:53:32.325389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d171b2-2b75-4f27-8da0-03d57d18fa71 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:32.335062 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d171b2-2b75-4f27-8da0-03d57d18fa71 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:32.345228 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdc96f-ae49-47ab-88c2-5d08e77abbb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:32.345969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc96f-ae49-47ab-88c2-5d08e77abbb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:32.346292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc96f-ae49-47ab-88c2-5d08e77abbb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:32.346572 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc96f-ae49-47ab-88c2-5d08e77abbb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:32.405126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdc96f-ae49-47ab-88c2-5d08e77abbb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:32.406541 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdc96f-ae49-47ab-88c2-5d08e77abbb5 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:32.416409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1210/2449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:32.444364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa508a-dc80-4374-985c-926f2dfce79c service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:32.446362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-eafa508a-dc80-4374-985c-926f2dfce79c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:32.513626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa508a-dc80-4374-985c-926f2dfce79c service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:32.518160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:32.518819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:32.519105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:32.519378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] PATH_INFO: `/v3/users/429c0fdb9460465c9c173fe4629eea4d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:32.520485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429c0fdb9460465c9c173fe4629eea4d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:32.522559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:32.801354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:32.806313 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429c0fdb9460465c9c173fe4629eea4d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:32.806985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429c0fdb9460465c9c173fe4629eea4d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:32.813733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429c0fdb9460465c9c173fe4629eea4d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:32.827046 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429c0fdb9460465c9c173fe4629eea4d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:32.906491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429c0fdb9460465c9c173fe4629eea4d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:32.912938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1240/2450] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:32 2022] DELETE /identity/v3/users/429c0fdb9460465c9c173fe4629eea4d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:32.917487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee9cdc-4648-47ef-97e5-21bb137941b3 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:32.918023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee9cdc-4648-47ef-97e5-21bb137941b3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:32.918295 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee9cdc-4648-47ef-97e5-21bb137941b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:32.938423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e2ee9cdc-4648-47ef-97e5-21bb137941b3 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:32.946976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e2ee9cdc-4648-47ef-97e5-21bb137941b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:32.967848 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:33.010761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1211/2451] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:33.023292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:33.024707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:33.089317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5906dd-3b2f-4a93-bb5d-1d978e74ebf9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:33.093208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a2ddc-42f6-4077-a6c3-484da9ebe981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:33.093822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2ddc-42f6-4077-a6c3-484da9ebe981 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:33.094105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2ddc-42f6-4077-a6c3-484da9ebe981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:33.094409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2ddc-42f6-4077-a6c3-484da9ebe981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:33.103786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a2ddc-42f6-4077-a6c3-484da9ebe981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:33.105232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a2ddc-42f6-4077-a6c3-484da9ebe981 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:33.114790 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1241/2452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:33.543056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee9cdc-4648-47ef-97e5-21bb137941b3 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:33.544597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e2ee9cdc-4648-47ef-97e5-21bb137941b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:33.557539 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee9cdc-4648-47ef-97e5-21bb137941b3 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:33.562438 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:33.563153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:33.563508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:33.563785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] PATH_INFO: `/v3/projects/50b82330a479439385658862983cf351` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:33.564896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b82330a479439385658862983cf351)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:33.567097 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:33.709408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b82330a479439385658862983cf351', 'request_id': 'req-e4beaae2-80f8-4acd-a304-cc7a6e088076'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:33.786469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b82330a479439385658862983cf351', 'request_id': 'req-e4beaae2-80f8-4acd-a304-cc7a6e088076'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:33.793104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b82330a479439385658862983cf351', 'request_id': 'req-e4beaae2-80f8-4acd-a304-cc7a6e088076'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:33.804166 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] The token cache is being invalidate because project 50b82330a479439385658862983cf351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:33.804491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:33.805188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4beaae2-80f8-4acd-a304-cc7a6e088076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:33.806722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1212/2453] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:33 2022] DELETE /identity/v3/projects/50b82330a479439385658862983cf351 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:33.811977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437081-df1f-4862-9422-e28033e585da None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:33.812458 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437081-df1f-4862-9422-e28033e585da None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:33.812556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437081-df1f-4862-9422-e28033e585da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:33.832509 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-67437081-df1f-4862-9422-e28033e585da None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:33.833710 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-67437081-df1f-4862-9422-e28033e585da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:33.895380 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1242/2454] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:33.904679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9a40c-ac2b-473a-b94b-a9cc1b6c12b8 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:33.905022 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9a40c-ac2b-473a-b94b-a9cc1b6c12b8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:33.905324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9a40c-ac2b-473a-b94b-a9cc1b6c12b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:33.926210 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c8a9a40c-ac2b-473a-b94b-a9cc1b6c12b8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:33.927429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c8a9a40c-ac2b-473a-b94b-a9cc1b6c12b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:33.935473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1213/2455] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:33.939839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67437081-df1f-4862-9422-e28033e585da None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:33.950375 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67437081-df1f-4862-9422-e28033e585da None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:33.954927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501004-77a0-42b1-8d8e-a0f08d9f8c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:33.955530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501004-77a0-42b1-8d8e-a0f08d9f8c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:33.957245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501004-77a0-42b1-8d8e-a0f08d9f8c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:33.957245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501004-77a0-42b1-8d8e-a0f08d9f8c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:33.957245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501004-77a0-42b1-8d8e-a0f08d9f8c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:33.957245 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501004-77a0-42b1-8d8e-a0f08d9f8c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:33.958748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501004-77a0-42b1-8d8e-a0f08d9f8c44 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:33.971955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1243/2456] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:53:33.976369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9a40c-ac2b-473a-b94b-a9cc1b6c12b8 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:33.986224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9a40c-ac2b-473a-b94b-a9cc1b6c12b8 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:33.991053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3889299-7be0-4dc9-a130-3794481fe1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:33.991685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3889299-7be0-4dc9-a130-3794481fe1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:33.992101 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3889299-7be0-4dc9-a130-3794481fe1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:33.995738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3889299-7be0-4dc9-a130-3794481fe1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:34.003423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3889299-7be0-4dc9-a130-3794481fe1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:34.003423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3889299-7be0-4dc9-a130-3794481fe1c5 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:34.144510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1214/2457] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:33 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:34.145983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501004-77a0-42b1-8d8e-a0f08d9f8c44 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:34.156886 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501004-77a0-42b1-8d8e-a0f08d9f8c44 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:34.205415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3889299-7be0-4dc9-a130-3794481fe1c5 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:34.207271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f3889299-7be0-4dc9-a130-3794481fe1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:34.208006 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:34.221351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe242a-fe2f-49ce-b165-3781748afe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:34.221973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe242a-fe2f-49ce-b165-3781748afe8e admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:34.222285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe242a-fe2f-49ce-b165-3781748afe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:34.222568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe242a-fe2f-49ce-b165-3781748afe8e admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:34.223203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe242a-fe2f-49ce-b165-3781748afe8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:34.225212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe242a-fe2f-49ce-b165-3781748afe8e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:34.276911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3889299-7be0-4dc9-a130-3794481fe1c5 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:34.281445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:34.282072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:34.282455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:34.282735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] PATH_INFO: `/v3/users/4e9f7f23e91d44cf812bcd36b5686295` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:34.283848 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9f7f23e91d44cf812bcd36b5686295)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:34.285745 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:34.309354 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:34.357220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1244/2458] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:34 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:34.361263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe242a-fe2f-49ce-b165-3781748afe8e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:34.371148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe242a-fe2f-49ce-b165-3781748afe8e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:34.375849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fcbd5-12e8-49cd-8eb3-8415981b8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:34.376427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcbd5-12e8-49cd-8eb3-8415981b8f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:34.376706 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcbd5-12e8-49cd-8eb3-8415981b8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:34.376978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcbd5-12e8-49cd-8eb3-8415981b8f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:34.377602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fcbd5-12e8-49cd-8eb3-8415981b8f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:34.379223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fcbd5-12e8-49cd-8eb3-8415981b8f8e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:34.391916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1245/2459] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:34.396024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fcbd5-12e8-49cd-8eb3-8415981b8f8e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:34.406682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fcbd5-12e8-49cd-8eb3-8415981b8f8e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:34.411640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af5948-26be-4c45-ab06-c3d1fd3b63e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:34.412240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5948-26be-4c45-ab06-c3d1fd3b63e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:34.412518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5948-26be-4c45-ab06-c3d1fd3b63e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:34.412817 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5948-26be-4c45-ab06-c3d1fd3b63e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:34.413484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af5948-26be-4c45-ab06-c3d1fd3b63e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:34.415792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af5948-26be-4c45-ab06-c3d1fd3b63e8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:34.425675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1246/2460] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:34.430055 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af5948-26be-4c45-ab06-c3d1fd3b63e8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:34.439377 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af5948-26be-4c45-ab06-c3d1fd3b63e8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:34.444555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881c8d3-da9b-4497-afa6-fee1c83c13d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:34.445200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881c8d3-da9b-4497-afa6-fee1c83c13d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:34.445479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881c8d3-da9b-4497-afa6-fee1c83c13d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:34.445753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881c8d3-da9b-4497-afa6-fee1c83c13d4 admin admin] PATH_INFO: `/v3/projects/f2ac265cb95c4775892dd5383de6f0ab/users/c112c69e800a44ea93ea7bc370abf8ce/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:34.459908 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881c8d3-da9b-4497-afa6-fee1c83c13d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ac265cb95c4775892dd5383de6f0ab, user_id=c112c69e800a44ea93ea7bc370abf8ce, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:34.464222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881c8d3-da9b-4497-afa6-fee1c83c13d4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:34.544067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9f7f23e91d44cf812bcd36b5686295'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:34.558697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9f7f23e91d44cf812bcd36b5686295'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:34.573440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1247/2461] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:34 2022] PUT /identity/v3/projects/f2ac265cb95c4775892dd5383de6f0ab/users/c112c69e800a44ea93ea7bc370abf8ce/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:34.583485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5799a-ed9e-4a83-b573-f6d01d2e0223 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:34.583764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5799a-ed9e-4a83-b573-f6d01d2e0223 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:34.584037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5799a-ed9e-4a83-b573-f6d01d2e0223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:34.612743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7ea5799a-ed9e-4a83-b573-f6d01d2e0223 None None] MFA Rules not processed for user `c112c69e800a44ea93ea7bc370abf8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:34.614039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7ea5799a-ed9e-4a83-b573-f6d01d2e0223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:34.680418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1248/2462] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:34.684797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5799a-ed9e-4a83-b573-f6d01d2e0223 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:34.685313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9f7f23e91d44cf812bcd36b5686295'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:34.693473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9f7f23e91d44cf812bcd36b5686295'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:34.694209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-04c875ee-50e3-49f2-9559-7de8a20f056c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9f7f23e91d44cf812bcd36b5686295'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:34.700878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1215/2463] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:34 2022] DELETE /identity/v3/users/4e9f7f23e91d44cf812bcd36b5686295 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:34.705164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29cd27-aa6d-45bf-9f3c-19799c8d9d2b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:34.705454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29cd27-aa6d-45bf-9f3c-19799c8d9d2b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:34.705737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29cd27-aa6d-45bf-9f3c-19799c8d9d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:34.725813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-de29cd27-aa6d-45bf-9f3c-19799c8d9d2b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:34.727290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-de29cd27-aa6d-45bf-9f3c-19799c8d9d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:34.750034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5799a-ed9e-4a83-b573-f6d01d2e0223 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:34.800864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1216/2464] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:34.812264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29cd27-aa6d-45bf-9f3c-19799c8d9d2b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:34.813817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-de29cd27-aa6d-45bf-9f3c-19799c8d9d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:34.826282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80672-eee2-4716-849c-7f5c51bbae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:34.827048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80672-eee2-4716-849c-7f5c51bbae3f admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:34.827256 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80672-eee2-4716-849c-7f5c51bbae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:34.827534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80672-eee2-4716-849c-7f5c51bbae3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:34.828222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80672-eee2-4716-849c-7f5c51bbae3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:34.830177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80672-eee2-4716-849c-7f5c51bbae3f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:34.876484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29cd27-aa6d-45bf-9f3c-19799c8d9d2b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:34.881128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eadc3b-f476-48eb-8ee0-bcc941765f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:34.881348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eadc3b-f476-48eb-8ee0-bcc941765f2c service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:34.881698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eadc3b-f476-48eb-8ee0-bcc941765f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:34.881981 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eadc3b-f476-48eb-8ee0-bcc941765f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:34.892284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eadc3b-f476-48eb-8ee0-bcc941765f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:34.893754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eadc3b-f476-48eb-8ee0-bcc941765f2c service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:34.903823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1217/2465] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:34.969540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1249/2466] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:34 2022] POST /identity/v3/projects => generated 375 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:34.971056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eadc3b-f476-48eb-8ee0-bcc941765f2c service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:34.972563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b2eadc3b-f476-48eb-8ee0-bcc941765f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:34.985595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eadc3b-f476-48eb-8ee0-bcc941765f2c service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:35.043803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f0438-061c-43d0-8170-15555f90ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:35.044056 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f0438-061c-43d0-8170-15555f90ed98 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.044443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f0438-061c-43d0-8170-15555f90ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.044607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f0438-061c-43d0-8170-15555f90ed98 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.045237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f0438-061c-43d0-8170-15555f90ed98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:35.047200 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f0438-061c-43d0-8170-15555f90ed98 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:35.182767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1218/2467] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:34 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:35.186512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80672-eee2-4716-849c-7f5c51bbae3f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:35.197556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80672-eee2-4716-849c-7f5c51bbae3f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:35.202170 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892c96f-9539-4bb0-89da-f4c8a0a43627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:35.202808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892c96f-9539-4bb0-89da-f4c8a0a43627 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.203091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892c96f-9539-4bb0-89da-f4c8a0a43627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.203394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892c96f-9539-4bb0-89da-f4c8a0a43627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.204043 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892c96f-9539-4bb0-89da-f4c8a0a43627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:35.205646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892c96f-9539-4bb0-89da-f4c8a0a43627 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:35.217061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1250/2468] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:35.228240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f0438-061c-43d0-8170-15555f90ed98 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:35.231143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f0438-061c-43d0-8170-15555f90ed98 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:35.235789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce133b4b-06cf-4143-b162-4cbefb1cc521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:35.236396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce133b4b-06cf-4143-b162-4cbefb1cc521 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.236681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce133b4b-06cf-4143-b162-4cbefb1cc521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.236956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce133b4b-06cf-4143-b162-4cbefb1cc521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.237984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce133b4b-06cf-4143-b162-4cbefb1cc521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:35.239243 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce133b4b-06cf-4143-b162-4cbefb1cc521 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:35.247782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:35.249933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1219/2469] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:35.254213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892c96f-9539-4bb0-89da-f4c8a0a43627 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:35.264685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892c96f-9539-4bb0-89da-f4c8a0a43627 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:35.269269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b65b70-bbe7-4e99-8500-d250151be1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:35.269921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b65b70-bbe7-4e99-8500-d250151be1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.270213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b65b70-bbe7-4e99-8500-d250151be1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.270547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b65b70-bbe7-4e99-8500-d250151be1ef admin admin] PATH_INFO: `/v3/projects/1cb72526009c41718c910a825a841b4d/users/39ebdd5623a540079b4909e1724e8eee/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.272412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:35.285140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b65b70-bbe7-4e99-8500-d250151be1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb72526009c41718c910a825a841b4d, user_id=39ebdd5623a540079b4909e1724e8eee, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:35.287890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b65b70-bbe7-4e99-8500-d250151be1ef admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:35.365293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce133b4b-06cf-4143-b162-4cbefb1cc521 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:35.368169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ce133b4b-06cf-4143-b162-4cbefb1cc521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:35.381815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce133b4b-06cf-4143-b162-4cbefb1cc521 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:35.388349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1251/2470] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:35 2022] PUT /identity/v3/projects/1cb72526009c41718c910a825a841b4d/users/39ebdd5623a540079b4909e1724e8eee/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:35.400094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f77a2-24d8-468a-8f31-f293c6cfa89e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.400382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f77a2-24d8-468a-8f31-f293c6cfa89e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.400665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f77a2-24d8-468a-8f31-f293c6cfa89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.434874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f16f77a2-24d8-468a-8f31-f293c6cfa89e None None] MFA Rules not processed for user `39ebdd5623a540079b4909e1724e8eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:35.436189 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f16f77a2-24d8-468a-8f31-f293c6cfa89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:35.455929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:35.456633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.456928 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.457207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] PATH_INFO: `/v3/projects/d7ce1780f0794b95b66ee5a05b79a015` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.458776 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ce1780f0794b95b66ee5a05b79a015)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:35.460454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:35.505652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1252/2471] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:35.510354 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f77a2-24d8-468a-8f31-f293c6cfa89e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:35.520747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f77a2-24d8-468a-8f31-f293c6cfa89e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:35.525721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bcec7-f921-48f9-9ac1-39c762012641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:35.526344 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bcec7-f921-48f9-9ac1-39c762012641 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.526628 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bcec7-f921-48f9-9ac1-39c762012641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.528173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bcec7-f921-48f9-9ac1-39c762012641 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.529154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bcec7-f921-48f9-9ac1-39c762012641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:35.531214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bcec7-f921-48f9-9ac1-39c762012641 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:35.620777 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ce1780f0794b95b66ee5a05b79a015', 'request_id': 'req-b2204cc4-a574-4f0f-80b7-7ef92d45f030'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:35.644023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1253/2472] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:35 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:35.647952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bcec7-f921-48f9-9ac1-39c762012641 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:35.707671 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bcec7-f921-48f9-9ac1-39c762012641 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:35.712491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a491a68-7c79-4db0-adb0-13ede07eea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:35.713098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a491a68-7c79-4db0-adb0-13ede07eea78 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.713383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a491a68-7c79-4db0-adb0-13ede07eea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.713659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a491a68-7c79-4db0-adb0-13ede07eea78 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.715865 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a491a68-7c79-4db0-adb0-13ede07eea78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:35.716474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a491a68-7c79-4db0-adb0-13ede07eea78 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:35.763880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ce1780f0794b95b66ee5a05b79a015', 'request_id': 'req-b2204cc4-a574-4f0f-80b7-7ef92d45f030'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:35.769841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ce1780f0794b95b66ee5a05b79a015', 'request_id': 'req-b2204cc4-a574-4f0f-80b7-7ef92d45f030'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:35.781566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] The token cache is being invalidate because project d7ce1780f0794b95b66ee5a05b79a015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:35.781882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:35.782572 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:35.784057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1220/2473] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:35 2022] DELETE /identity/v3/projects/d7ce1780f0794b95b66ee5a05b79a015 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:35.788016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:35.789953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:35.799482 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1254/2474] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:35 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:35.805511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a491a68-7c79-4db0-adb0-13ede07eea78 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:35.807120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8a491a68-7c79-4db0-adb0-13ede07eea78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:35.819291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a491a68-7c79-4db0-adb0-13ede07eea78 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:35.824160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37cfac-5312-4d46-89f2-fbda5978fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:35.824793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37cfac-5312-4d46-89f2-fbda5978fa76 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.825083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37cfac-5312-4d46-89f2-fbda5978fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.825363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37cfac-5312-4d46-89f2-fbda5978fa76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.826037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37cfac-5312-4d46-89f2-fbda5978fa76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:35.827673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37cfac-5312-4d46-89f2-fbda5978fa76 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:35.838274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1255/2475] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:35.842654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37cfac-5312-4d46-89f2-fbda5978fa76 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:35.852750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37cfac-5312-4d46-89f2-fbda5978fa76 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:35.856861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2204cc4-a574-4f0f-80b7-7ef92d45f030 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:35.857081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:35.859333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f410c45-955a-4eba-a6bd-c20e353ac85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:35.859983 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f410c45-955a-4eba-a6bd-c20e353ac85c admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.860289 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f410c45-955a-4eba-a6bd-c20e353ac85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.860575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f410c45-955a-4eba-a6bd-c20e353ac85c admin admin] PATH_INFO: `/v3/projects/992e77db612942e292dc5b7acd7c85bb/users/af22ca613aa84aa8a29b5c868a2379c6/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.861659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:35.865281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:35.865281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:35.865281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] PATH_INFO: `/v3/users/f748970aeb64491786f4dc30cbac445e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:35.865281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f748970aeb64491786f4dc30cbac445e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:35.866048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:35.885154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f410c45-955a-4eba-a6bd-c20e353ac85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=992e77db612942e292dc5b7acd7c85bb, user_id=af22ca613aa84aa8a29b5c868a2379c6, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:35.887953 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f410c45-955a-4eba-a6bd-c20e353ac85c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:35.977829 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1256/2476] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:35 2022] PUT /identity/v3/projects/992e77db612942e292dc5b7acd7c85bb/users/af22ca613aa84aa8a29b5c868a2379c6/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:35.981839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f410c45-955a-4eba-a6bd-c20e353ac85c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:36.041094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f410c45-955a-4eba-a6bd-c20e353ac85c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:36.045625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec827-3067-4d8f-af51-7c3986bf8cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:36.046252 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec827-3067-4d8f-af51-7c3986bf8cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:36.046537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec827-3067-4d8f-af51-7c3986bf8cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:36.046813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec827-3067-4d8f-af51-7c3986bf8cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:36.047443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ec827-3067-4d8f-af51-7c3986bf8cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:36.049134 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ec827-3067-4d8f-af51-7c3986bf8cd8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:36.053680 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f748970aeb64491786f4dc30cbac445e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:36.060491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1257/2477] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:36.064664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec827-3067-4d8f-af51-7c3986bf8cd8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:36.067450 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f748970aeb64491786f4dc30cbac445e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:36.076288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec827-3067-4d8f-af51-7c3986bf8cd8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:36.080961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5232b8-0609-457e-9676-e468711e98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:36.081642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5232b8-0609-457e-9676-e468711e98ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:36.081921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5232b8-0609-457e-9676-e468711e98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:36.082221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5232b8-0609-457e-9676-e468711e98ca admin admin] PATH_INFO: `/v3/projects/992e77db612942e292dc5b7acd7c85bb/users/af22ca613aa84aa8a29b5c868a2379c6/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:36.084224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5232b8-0609-457e-9676-e468711e98ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=992e77db612942e292dc5b7acd7c85bb, user_id=af22ca613aa84aa8a29b5c868a2379c6, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:36.087618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5232b8-0609-457e-9676-e468711e98ca admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:36.097981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1258/2478] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:36 2022] PUT /identity/v3/projects/992e77db612942e292dc5b7acd7c85bb/users/af22ca613aa84aa8a29b5c868a2379c6/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:36.125417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f748970aeb64491786f4dc30cbac445e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:36.134307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f748970aeb64491786f4dc30cbac445e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:36.135250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f748970aeb64491786f4dc30cbac445e'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:36.142320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1221/2479] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:35 2022] DELETE /identity/v3/users/f748970aeb64491786f4dc30cbac445e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:36.147773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:36.166076 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9564f3b-2fcd-4115-b6ed-4670e5944c22 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:36.166398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9564f3b-2fcd-4115-b6ed-4670e5944c22 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:36.166729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9564f3b-2fcd-4115-b6ed-4670e5944c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:36.204631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c9564f3b-2fcd-4115-b6ed-4670e5944c22 None None] MFA Rules not processed for user `af22ca613aa84aa8a29b5c868a2379c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:36.205867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c9564f3b-2fcd-4115-b6ed-4670e5944c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:36.280961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1259/2480] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:36.292621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:36.293991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:36.352520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76005640-5695-482d-ba8b-2bfb9a52bccd admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:36.356133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee3e49-7e83-4de2-af07-3d05de1fa069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:36.356747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee3e49-7e83-4de2-af07-3d05de1fa069 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:36.357362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee3e49-7e83-4de2-af07-3d05de1fa069 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:36.357953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee3e49-7e83-4de2-af07-3d05de1fa069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:36.359890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-97ee3e49-7e83-4de2-af07-3d05de1fa069 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:36.425742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee3e49-7e83-4de2-af07-3d05de1fa069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:36.427289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee3e49-7e83-4de2-af07-3d05de1fa069 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:36.437573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1222/2481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:36.918584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9564f3b-2fcd-4115-b6ed-4670e5944c22 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:36.920218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c9564f3b-2fcd-4115-b6ed-4670e5944c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:36.933492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:37.001493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9564f3b-2fcd-4115-b6ed-4670e5944c22 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:37.006086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:37.006756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:37.007042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:37.007323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] PATH_INFO: `/v3/projects/9c2fa14ceffe4aab9fa9cff699eb01dd` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:37.009027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2fa14ceffe4aab9fa9cff699eb01dd)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:37.010984 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:37.139399 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2fa14ceffe4aab9fa9cff699eb01dd', 'request_id': 'req-a9f7b8da-070a-4f2b-b587-91f63fe7f472'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:37.145751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2fa14ceffe4aab9fa9cff699eb01dd', 'request_id': 'req-a9f7b8da-070a-4f2b-b587-91f63fe7f472'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:37.270791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2fa14ceffe4aab9fa9cff699eb01dd', 'request_id': 'req-a9f7b8da-070a-4f2b-b587-91f63fe7f472'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:37.283522 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] The token cache is being invalidate because project 9c2fa14ceffe4aab9fa9cff699eb01dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:37.283819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:37.284473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a9f7b8da-070a-4f2b-b587-91f63fe7f472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:37.286006 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1260/2482] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:36 2022] DELETE /identity/v3/projects/9c2fa14ceffe4aab9fa9cff699eb01dd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:37.291148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f190b-1d4f-4dce-a922-36f9c93fd028 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:37.291632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f190b-1d4f-4dce-a922-36f9c93fd028 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:37.291749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f190b-1d4f-4dce-a922-36f9c93fd028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:37.317019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ff3f190b-1d4f-4dce-a922-36f9c93fd028 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:37.318248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ff3f190b-1d4f-4dce-a922-36f9c93fd028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:37.340444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:37.380100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1223/2483] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:37.388724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1e24f-fdaf-4b0d-8514-2d161e19dafb None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:37.389125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1e24f-fdaf-4b0d-8514-2d161e19dafb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:37.389409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1e24f-fdaf-4b0d-8514-2d161e19dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:37.412336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-77e1e24f-fdaf-4b0d-8514-2d161e19dafb None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:37.412336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-77e1e24f-fdaf-4b0d-8514-2d161e19dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:37.418962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1261/2484] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:37.423266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f190b-1d4f-4dce-a922-36f9c93fd028 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:37.433639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f190b-1d4f-4dce-a922-36f9c93fd028 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:37.438157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee36e79-a443-429a-b5af-ff56e2184be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:37.438775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee36e79-a443-429a-b5af-ff56e2184be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:37.439068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee36e79-a443-429a-b5af-ff56e2184be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:37.439322 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee36e79-a443-429a-b5af-ff56e2184be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:37.439955 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee36e79-a443-429a-b5af-ff56e2184be2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:37.440255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee36e79-a443-429a-b5af-ff56e2184be2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:37.441882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee36e79-a443-429a-b5af-ff56e2184be2 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:37.453797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1224/2485] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:37.458090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1e24f-fdaf-4b0d-8514-2d161e19dafb None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:37.468225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1e24f-fdaf-4b0d-8514-2d161e19dafb None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:37.473063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ca04-e4b8-440a-98be-465b731ab330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:37.473756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ca04-e4b8-440a-98be-465b731ab330 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:37.474062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ca04-e4b8-440a-98be-465b731ab330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:37.474455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ca04-e4b8-440a-98be-465b731ab330 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:37.475087 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99ca04-e4b8-440a-98be-465b731ab330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:37.477045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99ca04-e4b8-440a-98be-465b731ab330 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:37.594757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1262/2486] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:37 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:37.598920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee36e79-a443-429a-b5af-ff56e2184be2 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:37.608779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee36e79-a443-429a-b5af-ff56e2184be2 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:37.664572 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922a3cd-5b7f-47a9-9a62-9db99d051d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:37.665098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922a3cd-5b7f-47a9-9a62-9db99d051d50 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:37.665386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922a3cd-5b7f-47a9-9a62-9db99d051d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:37.665659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922a3cd-5b7f-47a9-9a62-9db99d051d50 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:37.666841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922a3cd-5b7f-47a9-9a62-9db99d051d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:37.668781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922a3cd-5b7f-47a9-9a62-9db99d051d50 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:37.752484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1225/2487] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:37 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:37.756503 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ca04-e4b8-440a-98be-465b731ab330 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:37.767123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ca04-e4b8-440a-98be-465b731ab330 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:37.771898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a926b0-ece1-4908-b4d8-2d77b2fd5473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:37.772506 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a926b0-ece1-4908-b4d8-2d77b2fd5473 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:37.772793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a926b0-ece1-4908-b4d8-2d77b2fd5473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:37.773064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a926b0-ece1-4908-b4d8-2d77b2fd5473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:37.773711 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a926b0-ece1-4908-b4d8-2d77b2fd5473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:37.775366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a926b0-ece1-4908-b4d8-2d77b2fd5473 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:37.794541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1263/2488] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:37.797674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922a3cd-5b7f-47a9-9a62-9db99d051d50 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:37.811595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922a3cd-5b7f-47a9-9a62-9db99d051d50 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:37.816603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb182ce-0a71-4515-ae67-bd1508ab957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:37.817270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb182ce-0a71-4515-ae67-bd1508ab957d admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:37.817559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb182ce-0a71-4515-ae67-bd1508ab957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:37.817837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb182ce-0a71-4515-ae67-bd1508ab957d admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:37.818529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb182ce-0a71-4515-ae67-bd1508ab957d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:37.820123 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb182ce-0a71-4515-ae67-bd1508ab957d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:37.831563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1226/2489] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:37.835423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a926b0-ece1-4908-b4d8-2d77b2fd5473 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:37.846585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a926b0-ece1-4908-b4d8-2d77b2fd5473 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:37.851903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b274fe-5706-473d-9d6a-5644967f199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:37.852564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b274fe-5706-473d-9d6a-5644967f199b admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:37.852846 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b274fe-5706-473d-9d6a-5644967f199b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:37.853143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b274fe-5706-473d-9d6a-5644967f199b admin admin] PATH_INFO: `/v3/projects/2c6cf92b681b487eb55b61c30352e7ee/users/d82b120fbabf417797eb95927217bc17/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:37.868667 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b274fe-5706-473d-9d6a-5644967f199b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6cf92b681b487eb55b61c30352e7ee, user_id=d82b120fbabf417797eb95927217bc17, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:37.871748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b274fe-5706-473d-9d6a-5644967f199b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:37.962184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1264/2490] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:37 2022] PUT /identity/v3/projects/2c6cf92b681b487eb55b61c30352e7ee/users/d82b120fbabf417797eb95927217bc17/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:37.973939 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dee094-1e63-466e-a61c-708e753dca38 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:37.974269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dee094-1e63-466e-a61c-708e753dca38 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:37.974551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dee094-1e63-466e-a61c-708e753dca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.004012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a9dee094-1e63-466e-a61c-708e753dca38 None None] MFA Rules not processed for user `d82b120fbabf417797eb95927217bc17`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:38.005216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a9dee094-1e63-466e-a61c-708e753dca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:38.071964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1227/2491] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:38.076727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b274fe-5706-473d-9d6a-5644967f199b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:38.118927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:38.141675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b274fe-5706-473d-9d6a-5644967f199b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:38.146330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451057d1-97d2-4ac5-a4fc-6e2e58bd1eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:38.146929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451057d1-97d2-4ac5-a4fc-6e2e58bd1eca admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.147206 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451057d1-97d2-4ac5-a4fc-6e2e58bd1eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.147477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451057d1-97d2-4ac5-a4fc-6e2e58bd1eca admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.148093 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451057d1-97d2-4ac5-a4fc-6e2e58bd1eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:38.150023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451057d1-97d2-4ac5-a4fc-6e2e58bd1eca admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:38.253780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1265/2492] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:38 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:38.257406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dee094-1e63-466e-a61c-708e753dca38 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:38.271676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dee094-1e63-466e-a61c-708e753dca38 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:38.332071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a614-574c-4914-b317-808506f92657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:38.332890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a614-574c-4914-b317-808506f92657 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.333258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a614-574c-4914-b317-808506f92657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.333767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a614-574c-4914-b317-808506f92657 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.334467 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40a614-574c-4914-b317-808506f92657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:38.336608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40a614-574c-4914-b317-808506f92657 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:38.444106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1228/2493] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:38 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:38.449259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451057d1-97d2-4ac5-a4fc-6e2e58bd1eca admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:38.460848 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451057d1-97d2-4ac5-a4fc-6e2e58bd1eca admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:38.467024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5ea0a-f51e-44ce-81b7-7734525a345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:38.467683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5ea0a-f51e-44ce-81b7-7734525a345f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.467992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5ea0a-f51e-44ce-81b7-7734525a345f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.468306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5ea0a-f51e-44ce-81b7-7734525a345f admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.468956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5ea0a-f51e-44ce-81b7-7734525a345f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:38.470626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5ea0a-f51e-44ce-81b7-7734525a345f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:38.480822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1266/2494] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:38.485027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a614-574c-4914-b317-808506f92657 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:38.495793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a614-574c-4914-b317-808506f92657 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:38.505867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418505-6569-4e74-9807-76b0095161ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:38.506605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418505-6569-4e74-9807-76b0095161ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.506895 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418505-6569-4e74-9807-76b0095161ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.507178 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418505-6569-4e74-9807-76b0095161ff admin admin] PATH_INFO: `/v3/projects/be2be45dcd12431694c80d9d751b500e/users/46fd01df420f4a94b96fc122260a2aa1/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.524787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a418505-6569-4e74-9807-76b0095161ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2be45dcd12431694c80d9d751b500e, user_id=46fd01df420f4a94b96fc122260a2aa1, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:38.528157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a418505-6569-4e74-9807-76b0095161ff admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:38.613009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5ea0a-f51e-44ce-81b7-7734525a345f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:38.614771 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ffb5ea0a-f51e-44ce-81b7-7734525a345f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:38.638743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1229/2495] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:38 2022] PUT /identity/v3/projects/be2be45dcd12431694c80d9d751b500e/users/46fd01df420f4a94b96fc122260a2aa1/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:38.642633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418505-6569-4e74-9807-76b0095161ff admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:38.675222 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5ea0a-f51e-44ce-81b7-7734525a345f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:38.707547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418505-6569-4e74-9807-76b0095161ff admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:38.712374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f24ee-01d6-47ca-b43d-99be6b9d3366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:38.712974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f24ee-01d6-47ca-b43d-99be6b9d3366 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.713317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f24ee-01d6-47ca-b43d-99be6b9d3366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.714182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f24ee-01d6-47ca-b43d-99be6b9d3366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.715250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f24ee-01d6-47ca-b43d-99be6b9d3366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:38.716861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f24ee-01d6-47ca-b43d-99be6b9d3366 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:38.730338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1230/2496] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:38.730520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffe055-8487-427a-a95e-7a0c52755e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:38.730520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffe055-8487-427a-a95e-7a0c52755e6f service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.730520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffe055-8487-427a-a95e-7a0c52755e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.730520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffe055-8487-427a-a95e-7a0c52755e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.731468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f24ee-01d6-47ca-b43d-99be6b9d3366 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:38.731801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-90ffe055-8487-427a-a95e-7a0c52755e6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:38.741463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f24ee-01d6-47ca-b43d-99be6b9d3366 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:38.746567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e53fa-63c8-4a56-b280-d65c4adf2c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:38.747569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e53fa-63c8-4a56-b280-d65c4adf2c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.747569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e53fa-63c8-4a56-b280-d65c4adf2c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.747798 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e53fa-63c8-4a56-b280-d65c4adf2c32 admin admin] PATH_INFO: `/v3/projects/be2be45dcd12431694c80d9d751b500e/users/46fd01df420f4a94b96fc122260a2aa1/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.749736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e53fa-63c8-4a56-b280-d65c4adf2c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2be45dcd12431694c80d9d751b500e, user_id=46fd01df420f4a94b96fc122260a2aa1, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:38.752462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e53fa-63c8-4a56-b280-d65c4adf2c32 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:38.763499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1231/2497] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:38 2022] PUT /identity/v3/projects/be2be45dcd12431694c80d9d751b500e/users/46fd01df420f4a94b96fc122260a2aa1/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:38.773102 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef3f25-e48a-4207-b621-e2a23add3c25 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.773389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef3f25-e48a-4207-b621-e2a23add3c25 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.774816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef3f25-e48a-4207-b621-e2a23add3c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.792738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffe055-8487-427a-a95e-7a0c52755e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:38.794212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffe055-8487-427a-a95e-7a0c52755e6f service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:38.802693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-fbef3f25-e48a-4207-b621-e2a23add3c25 None None] MFA Rules not processed for user `46fd01df420f4a94b96fc122260a2aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:38.803329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1267/2498] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:38.804104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-fbef3f25-e48a-4207-b621-e2a23add3c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:38.877941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1232/2499] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:38.921568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffe055-8487-427a-a95e-7a0c52755e6f service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:38.922998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-90ffe055-8487-427a-a95e-7a0c52755e6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:38.934302 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffe055-8487-427a-a95e-7a0c52755e6f service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:38.962214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:38.984811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ba6ba-2ef4-4cc2-91d2-e9d067ca6618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:38.985492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ba6ba-2ef4-4cc2-91d2-e9d067ca6618 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.985727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ba6ba-2ef4-4cc2-91d2-e9d067ca6618 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.986000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ba6ba-2ef4-4cc2-91d2-e9d067ca6618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.995681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ba6ba-2ef4-4cc2-91d2-e9d067ca6618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:38.997124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ba6ba-2ef4-4cc2-91d2-e9d067ca6618 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:39.007429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1268/2500] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:39.552702 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:40.253581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:40.476959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef3f25-e48a-4207-b621-e2a23add3c25 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:40.489133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef3f25-e48a-4207-b621-e2a23add3c25 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:40.495099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1dc1e-3d01-48c3-a8da-ca549b08efb1 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fd01df420f4a94b96fc122260a2aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2be45dcd12431694c80d9d751b500e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:40.498888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1dc1e-3d01-48c3-a8da-ca549b08efb1 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:40.498888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1dc1e-3d01-48c3-a8da-ca549b08efb1 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:40.498888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1dc1e-3d01-48c3-a8da-ca549b08efb1 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:40.498888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1dc1e-3d01-48c3-a8da-ca549b08efb1 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:40.498888 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1dc1e-3d01-48c3-a8da-ca549b08efb1 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:40.499700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1dc1e-3d01-48c3-a8da-ca549b08efb1 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:40.518216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1233/2501] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:53:40.520012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ba6ba-2ef4-4cc2-91d2-e9d067ca6618 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:40.533119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ba6ba-2ef4-4cc2-91d2-e9d067ca6618 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:40.539277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d35468-c424-42de-a87d-b57c13928b76 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fd01df420f4a94b96fc122260a2aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2be45dcd12431694c80d9d751b500e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:40.540217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d35468-c424-42de-a87d-b57c13928b76 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:40.540716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d35468-c424-42de-a87d-b57c13928b76 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:40.541081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d35468-c424-42de-a87d-b57c13928b76 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:40.542688 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d35468-c424-42de-a87d-b57c13928b76 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:40.544898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d35468-c424-42de-a87d-b57c13928b76 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:40.749615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1269/2502] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:40 2022] POST /identity/v3/projects => generated 355 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:40.753796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1dc1e-3d01-48c3-a8da-ca549b08efb1 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:40.765750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1dc1e-3d01-48c3-a8da-ca549b08efb1 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:40.773574 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d35468-c424-42de-a87d-b57c13928b76 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:40.828546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7756a-2def-49f4-b0fd-1e055af8ba42 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fd01df420f4a94b96fc122260a2aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2be45dcd12431694c80d9d751b500e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:40.829286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7756a-2def-49f4-b0fd-1e055af8ba42 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:40.829629 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7756a-2def-49f4-b0fd-1e055af8ba42 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:40.830001 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7756a-2def-49f4-b0fd-1e055af8ba42 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:40.830863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7756a-2def-49f4-b0fd-1e055af8ba42 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:40.831331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7756a-2def-49f4-b0fd-1e055af8ba42 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:40.831452 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d35468-c424-42de-a87d-b57c13928b76 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:40.833443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7756a-2def-49f4-b0fd-1e055af8ba42 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:40.835054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f256c-c1cf-4b38-a6d3-8cfd94a827ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:40.835661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f256c-c1cf-4b38-a6d3-8cfd94a827ab service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:40.835936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f256c-c1cf-4b38-a6d3-8cfd94a827ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:40.836287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f256c-c1cf-4b38-a6d3-8cfd94a827ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:40.837970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-471f256c-c1cf-4b38-a6d3-8cfd94a827ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:40.853868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1234/2503] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:40.902938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f256c-c1cf-4b38-a6d3-8cfd94a827ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:40.904675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f256c-c1cf-4b38-a6d3-8cfd94a827ab service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:40.915181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1270/2504] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:40.992459 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7756a-2def-49f4-b0fd-1e055af8ba42 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:41.004598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7756a-2def-49f4-b0fd-1e055af8ba42 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:41.009524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fd01df420f4a94b96fc122260a2aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2be45dcd12431694c80d9d751b500e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:41.010887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:41.011207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:41.011459 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] PATH_INFO: `/v3/projects/30623de01ee74d00ab768f683c26e386` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:41.012642 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: Authorizing `identity:delete_project(project_id=30623de01ee74d00ab768f683c26e386)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:41.014727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:41.179019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30623de01ee74d00ab768f683c26e386', 'request_id': 'req-58c6a631-d5d8-460e-8558-0d32de2dd8a6'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:41.254743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30623de01ee74d00ab768f683c26e386', 'request_id': 'req-58c6a631-d5d8-460e-8558-0d32de2dd8a6'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:41.262468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30623de01ee74d00ab768f683c26e386', 'request_id': 'req-58c6a631-d5d8-460e-8558-0d32de2dd8a6'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:41.274847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] The token cache is being invalidate because project 30623de01ee74d00ab768f683c26e386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:41.275139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:41.275814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-58c6a631-d5d8-460e-8558-0d32de2dd8a6 tempest-VolumeQuotaClassesTest-2059945882 tempest-VolumeQuotaClassesTest-2059945882-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:41.277513 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1235/2505] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:40 2022] DELETE /identity/v3/projects/30623de01ee74d00ab768f683c26e386 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:42.211357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f256c-c1cf-4b38-a6d3-8cfd94a827ab service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:42.272383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:42.285117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f256c-c1cf-4b38-a6d3-8cfd94a827ab service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:42.345870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:42.346717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:42.347298 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:42.347650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] PATH_INFO: `/v3/users/d82b120fbabf417797eb95927217bc17` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:42.348878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82b120fbabf417797eb95927217bc17)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:42.350856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:42.700154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82b120fbabf417797eb95927217bc17'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:42.700863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82b120fbabf417797eb95927217bc17'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:42.708536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82b120fbabf417797eb95927217bc17'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:42.723666 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82b120fbabf417797eb95927217bc17'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:42.803415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82b120fbabf417797eb95927217bc17'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:42.810436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1271/2506] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:42 2022] DELETE /identity/v3/users/d82b120fbabf417797eb95927217bc17 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:42.815061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cdb8c-70e3-4d2d-8ec6-0782d0439675 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:42.815582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cdb8c-70e3-4d2d-8ec6-0782d0439675 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:42.815693 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cdb8c-70e3-4d2d-8ec6-0782d0439675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:42.835747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-708cdb8c-70e3-4d2d-8ec6-0782d0439675 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:42.836990 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-708cdb8c-70e3-4d2d-8ec6-0782d0439675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:42.891493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:42.899892 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1236/2507] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:42.910674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:42.912829 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:42.982062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978f18e-ae83-43f7-b261-f1d78a8a80ab admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:42.985974 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de14e0-eff5-4549-a60e-9c098c9155a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:42.986760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de14e0-eff5-4549-a60e-9c098c9155a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:42.987015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de14e0-eff5-4549-a60e-9c098c9155a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:42.987271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de14e0-eff5-4549-a60e-9c098c9155a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:42.996585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de14e0-eff5-4549-a60e-9c098c9155a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:42.998127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de14e0-eff5-4549-a60e-9c098c9155a9 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:43.008442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1272/2508] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:43.475751 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cdb8c-70e3-4d2d-8ec6-0782d0439675 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:43.477344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-708cdb8c-70e3-4d2d-8ec6-0782d0439675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:43.491710 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cdb8c-70e3-4d2d-8ec6-0782d0439675 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:43.497902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:43.498737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:43.498921 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:43.499197 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] PATH_INFO: `/v3/projects/2c6cf92b681b487eb55b61c30352e7ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:43.500346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6cf92b681b487eb55b61c30352e7ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:43.502388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:43.616280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6cf92b681b487eb55b61c30352e7ee', 'request_id': 'req-d55fafed-300d-4f11-8a70-66996de6db17'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:43.734687 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6cf92b681b487eb55b61c30352e7ee', 'request_id': 'req-d55fafed-300d-4f11-8a70-66996de6db17'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:43.741426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6cf92b681b487eb55b61c30352e7ee', 'request_id': 'req-d55fafed-300d-4f11-8a70-66996de6db17'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:43.754503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] The token cache is being invalidate because project 2c6cf92b681b487eb55b61c30352e7ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:43.754791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:43.755423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:43.756902 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1237/2509] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:43 2022] DELETE /identity/v3/projects/2c6cf92b681b487eb55b61c30352e7ee => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:43.761859 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de14e0-eff5-4549-a60e-9c098c9155a9 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:43.771893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de14e0-eff5-4549-a60e-9c098c9155a9 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:43.788933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:43.828695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:43.829447 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:43.829856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:43.830171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] PATH_INFO: `/v3/users/46fd01df420f4a94b96fc122260a2aa1` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:43.831592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=46fd01df420f4a94b96fc122260a2aa1)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:43.834235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:44.000167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46fd01df420f4a94b96fc122260a2aa1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:44.000921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46fd01df420f4a94b96fc122260a2aa1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:44.008559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46fd01df420f4a94b96fc122260a2aa1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:44.022105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46fd01df420f4a94b96fc122260a2aa1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:44.141020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-14228203-2259-4caf-a0ec-e6ecba65ea3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46fd01df420f4a94b96fc122260a2aa1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:44.148195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1273/2510] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:43 2022] DELETE /identity/v3/users/46fd01df420f4a94b96fc122260a2aa1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:44.634000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:44.634757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:44.660893 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fafed-300d-4f11-8a70-66996de6db17 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:44.725016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:44.725766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:44.726094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:44.726413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] PATH_INFO: `/v3/projects/be2be45dcd12431694c80d9d751b500e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:44.727987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2be45dcd12431694c80d9d751b500e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:44.730789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:44.868353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2be45dcd12431694c80d9d751b500e', 'request_id': 'req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:44.965278 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2be45dcd12431694c80d9d751b500e', 'request_id': 'req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:44.974934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2be45dcd12431694c80d9d751b500e', 'request_id': 'req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:44.987950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] The token cache is being invalidate because project be2be45dcd12431694c80d9d751b500e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:44.988270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:44.988923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-12c757f6-81c7-4fd7-af02-0fa9e85d20bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:44.990462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1238/2511] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:44 2022] DELETE /identity/v3/projects/be2be45dcd12431694c80d9d751b500e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:44.996101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b54b-89a0-4bcb-97a8-19afb0a667ed None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:44.996548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b54b-89a0-4bcb-97a8-19afb0a667ed None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:44.996785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b54b-89a0-4bcb-97a8-19afb0a667ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:45.018742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-77b1b54b-89a0-4bcb-97a8-19afb0a667ed None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:45.019964 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-77b1b54b-89a0-4bcb-97a8-19afb0a667ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:45.084312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1274/2512] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:45.093361 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a704c-96a2-4399-85c7-be504bb46809 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:45.093685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a704c-96a2-4399-85c7-be504bb46809 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:45.094144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a704c-96a2-4399-85c7-be504bb46809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:45.125976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-4b2a704c-96a2-4399-85c7-be504bb46809 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:45.127149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-4b2a704c-96a2-4399-85c7-be504bb46809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:45.135781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1239/2513] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:45.140072 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1b54b-89a0-4bcb-97a8-19afb0a667ed None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:45.150151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1b54b-89a0-4bcb-97a8-19afb0a667ed None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:45.156057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cf4f0-c9b0-4686-8427-5cd730ec8566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:45.156664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cf4f0-c9b0-4686-8427-5cd730ec8566 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:45.156952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cf4f0-c9b0-4686-8427-5cd730ec8566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:45.157235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cf4f0-c9b0-4686-8427-5cd730ec8566 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:45.157879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cf4f0-c9b0-4686-8427-5cd730ec8566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:45.158186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cf4f0-c9b0-4686-8427-5cd730ec8566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:45.159827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cf4f0-c9b0-4686-8427-5cd730ec8566 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:45.172899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1275/2514] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:45.179908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a704c-96a2-4399-85c7-be504bb46809 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:45.190146 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a704c-96a2-4399-85c7-be504bb46809 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:45.195178 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816377c7-dfef-4f43-9cd5-605decf7769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:45.195950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816377c7-dfef-4f43-9cd5-605decf7769c admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:45.196236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816377c7-dfef-4f43-9cd5-605decf7769c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:45.196522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816377c7-dfef-4f43-9cd5-605decf7769c admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:45.197227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816377c7-dfef-4f43-9cd5-605decf7769c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:45.200219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816377c7-dfef-4f43-9cd5-605decf7769c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:45.204997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:45.295276 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1240/2515] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:45 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:45.296300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cf4f0-c9b0-4686-8427-5cd730ec8566 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:45.307300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cf4f0-c9b0-4686-8427-5cd730ec8566 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:45.332067 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:45.366903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4133-a6f4-4600-a064-137ac7796aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:45.370331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4133-a6f4-4600-a064-137ac7796aaf admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:45.370331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4133-a6f4-4600-a064-137ac7796aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:45.370331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4133-a6f4-4600-a064-137ac7796aaf admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:45.370331 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4133-a6f4-4600-a064-137ac7796aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:45.370783 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4133-a6f4-4600-a064-137ac7796aaf admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:45.560958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1276/2516] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:45 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:45.565182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816377c7-dfef-4f43-9cd5-605decf7769c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:45.576525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816377c7-dfef-4f43-9cd5-605decf7769c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:45.581468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258747-d042-4566-8ec3-ac6446e1b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:45.582378 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258747-d042-4566-8ec3-ac6446e1b5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:45.582664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258747-d042-4566-8ec3-ac6446e1b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:45.582942 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258747-d042-4566-8ec3-ac6446e1b5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:45.583575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51258747-d042-4566-8ec3-ac6446e1b5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:45.585670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51258747-d042-4566-8ec3-ac6446e1b5cc admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:45.596978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1241/2517] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:45.601194 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4133-a6f4-4600-a064-137ac7796aaf admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:45.611475 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4133-a6f4-4600-a064-137ac7796aaf admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:45.616115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c60f8-844a-473f-8a97-845613f0ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:45.616722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c60f8-844a-473f-8a97-845613f0ce08 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:45.617005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c60f8-844a-473f-8a97-845613f0ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:45.617283 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c60f8-844a-473f-8a97-845613f0ce08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:45.617924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c60f8-844a-473f-8a97-845613f0ce08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:45.620301 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c60f8-844a-473f-8a97-845613f0ce08 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:45.630965 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1277/2518] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:45.635788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258747-d042-4566-8ec3-ac6446e1b5cc admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:45.646033 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258747-d042-4566-8ec3-ac6446e1b5cc admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:45.650831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5c7c7-ba9b-4199-bbaf-17955d443519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:45.651538 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5c7c7-ba9b-4199-bbaf-17955d443519 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:45.651848 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5c7c7-ba9b-4199-bbaf-17955d443519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:45.652126 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5c7c7-ba9b-4199-bbaf-17955d443519 admin admin] PATH_INFO: `/v3/projects/e2b66d029d4f4086973a70e7da28ec9b/users/af959a14069b4a9590a566024346eb61/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:45.667820 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5c7c7-ba9b-4199-bbaf-17955d443519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b66d029d4f4086973a70e7da28ec9b, user_id=af959a14069b4a9590a566024346eb61, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:45.670554 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5c7c7-ba9b-4199-bbaf-17955d443519 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:45.827795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c60f8-844a-473f-8a97-845613f0ce08 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:45.829644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ce8c60f8-844a-473f-8a97-845613f0ce08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:45.846010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c60f8-844a-473f-8a97-845613f0ce08 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:45.851494 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:45.852239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:45.852593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:45.852930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] PATH_INFO: `/v3/users/c112c69e800a44ea93ea7bc370abf8ce` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:45.854364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c112c69e800a44ea93ea7bc370abf8ce)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:45.856744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.042566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1242/2519] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:45 2022] PUT /identity/v3/projects/e2b66d029d4f4086973a70e7da28ec9b/users/af959a14069b4a9590a566024346eb61/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:46.053821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb3b02-fa01-4ac3-aa48-f5b87cf094ae None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.054108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb3b02-fa01-4ac3-aa48-f5b87cf094ae None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.054415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb3b02-fa01-4ac3-aa48-f5b87cf094ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.084338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-76eb3b02-fa01-4ac3-aa48-f5b87cf094ae None None] MFA Rules not processed for user `af959a14069b4a9590a566024346eb61`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:46.085571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-76eb3b02-fa01-4ac3-aa48-f5b87cf094ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:46.154977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1243/2520] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:46.159968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb3b02-fa01-4ac3-aa48-f5b87cf094ae None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.165815 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c112c69e800a44ea93ea7bc370abf8ce'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:46.174971 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c112c69e800a44ea93ea7bc370abf8ce'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:46.183257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c112c69e800a44ea93ea7bc370abf8ce'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:46.198773 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c112c69e800a44ea93ea7bc370abf8ce'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:46.225412 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb3b02-fa01-4ac3-aa48-f5b87cf094ae None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.230565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720020b-56a5-46f2-b82c-1318bdd06cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.231173 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720020b-56a5-46f2-b82c-1318bdd06cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.231454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720020b-56a5-46f2-b82c-1318bdd06cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.231727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720020b-56a5-46f2-b82c-1318bdd06cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.232352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720020b-56a5-46f2-b82c-1318bdd06cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.234291 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720020b-56a5-46f2-b82c-1318bdd06cfd admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.287326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-52cc3183-291f-45a4-b8f0-aa6b077b430e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c112c69e800a44ea93ea7bc370abf8ce'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:46.294740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1278/2521] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:45 2022] DELETE /identity/v3/users/c112c69e800a44ea93ea7bc370abf8ce => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:46.299061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3c486-a653-46b0-8dcc-9b704a21511c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.299339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3c486-a653-46b0-8dcc-9b704a21511c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.299617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3c486-a653-46b0-8dcc-9b704a21511c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.319869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-cff3c486-a653-46b0-8dcc-9b704a21511c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:46.319869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cff3c486-a653-46b0-8dcc-9b704a21511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:46.347759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1244/2522] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:46 2022] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:46.356651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720020b-56a5-46f2-b82c-1318bdd06cfd admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.356651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5720020b-56a5-46f2-b82c-1318bdd06cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:46.382296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:46.388290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1279/2523] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:46.396319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3c486-a653-46b0-8dcc-9b704a21511c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.397672 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cff3c486-a653-46b0-8dcc-9b704a21511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:46.419291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:46.423032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720020b-56a5-46f2-b82c-1318bdd06cfd admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.428968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc67fb-a47d-40c6-ba04-87b7ad3ebf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.431397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc67fb-a47d-40c6-ba04-87b7ad3ebf00 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.431397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc67fb-a47d-40c6-ba04-87b7ad3ebf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.431397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc67fb-a47d-40c6-ba04-87b7ad3ebf00 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.431397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc67fb-a47d-40c6-ba04-87b7ad3ebf00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.433389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc67fb-a47d-40c6-ba04-87b7ad3ebf00 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.458312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3c486-a653-46b0-8dcc-9b704a21511c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.510693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d9520-1fa3-4016-8bb1-8e0d446d8973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.511413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d9520-1fa3-4016-8bb1-8e0d446d8973 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.511694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d9520-1fa3-4016-8bb1-8e0d446d8973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.511967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d9520-1fa3-4016-8bb1-8e0d446d8973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.520732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d9520-1fa3-4016-8bb1-8e0d446d8973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.522219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d9520-1fa3-4016-8bb1-8e0d446d8973 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.533801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1245/2524] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:46 2022] POST /identity/v3/users => generated 303 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:46.534014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1280/2525] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:53:46.535277 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc67fb-a47d-40c6-ba04-87b7ad3ebf00 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.545764 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc67fb-a47d-40c6-ba04-87b7ad3ebf00 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.550464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877bd4b-0388-41ca-b250-687d7d261c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.551098 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877bd4b-0388-41ca-b250-687d7d261c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.551385 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877bd4b-0388-41ca-b250-687d7d261c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.551656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877bd4b-0388-41ca-b250-687d7d261c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.552296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877bd4b-0388-41ca-b250-687d7d261c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.553883 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877bd4b-0388-41ca-b250-687d7d261c00 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.564934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1246/2526] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:46.570123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d9520-1fa3-4016-8bb1-8e0d446d8973 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.580233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d9520-1fa3-4016-8bb1-8e0d446d8973 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.585175 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593bbea-436d-48f6-85d3-b8eecf37fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.585839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593bbea-436d-48f6-85d3-b8eecf37fc4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.586133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593bbea-436d-48f6-85d3-b8eecf37fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.586446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593bbea-436d-48f6-85d3-b8eecf37fc4e admin admin] PATH_INFO: `/v3/projects/8fdbe1f6dd17417fafd5a2204301ba9a/users/7ce89bec1bca482fa71f972dbec7982a/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.605294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593bbea-436d-48f6-85d3-b8eecf37fc4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdbe1f6dd17417fafd5a2204301ba9a, user_id=7ce89bec1bca482fa71f972dbec7982a, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.608746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593bbea-436d-48f6-85d3-b8eecf37fc4e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.712638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1281/2527] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:46 2022] PUT /identity/v3/projects/8fdbe1f6dd17417fafd5a2204301ba9a/users/7ce89bec1bca482fa71f972dbec7982a/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:46.717656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877bd4b-0388-41ca-b250-687d7d261c00 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.728366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877bd4b-0388-41ca-b250-687d7d261c00 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.803812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aef9bf-4a66-435b-a93f-744c953b01a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.804851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aef9bf-4a66-435b-a93f-744c953b01a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.808143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aef9bf-4a66-435b-a93f-744c953b01a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.808143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aef9bf-4a66-435b-a93f-744c953b01a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.808143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aef9bf-4a66-435b-a93f-744c953b01a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.808435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aef9bf-4a66-435b-a93f-744c953b01a6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.821469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1247/2528] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:46.826638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593bbea-436d-48f6-85d3-b8eecf37fc4e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.837579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593bbea-436d-48f6-85d3-b8eecf37fc4e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.843863 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989cfb-26da-4164-9450-46b2df961183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.844565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989cfb-26da-4164-9450-46b2df961183 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.844852 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989cfb-26da-4164-9450-46b2df961183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.845130 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989cfb-26da-4164-9450-46b2df961183 admin admin] PATH_INFO: `/v3/projects/8fdbe1f6dd17417fafd5a2204301ba9a/users/7ce89bec1bca482fa71f972dbec7982a/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.847143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e989cfb-26da-4164-9450-46b2df961183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdbe1f6dd17417fafd5a2204301ba9a, user_id=7ce89bec1bca482fa71f972dbec7982a, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.850274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e989cfb-26da-4164-9450-46b2df961183 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.862428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1282/2529] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:46 2022] PUT /identity/v3/projects/8fdbe1f6dd17417fafd5a2204301ba9a/users/7ce89bec1bca482fa71f972dbec7982a/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:46.874019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba20202-558a-4368-bcfb-859089b95cce None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.874345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba20202-558a-4368-bcfb-859089b95cce None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.874612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba20202-558a-4368-bcfb-859089b95cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.906233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-cba20202-558a-4368-bcfb-859089b95cce None None] MFA Rules not processed for user `7ce89bec1bca482fa71f972dbec7982a`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:46.907646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cba20202-558a-4368-bcfb-859089b95cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:46.984408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1248/2530] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:46.997352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989cfb-26da-4164-9450-46b2df961183 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.999248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1e989cfb-26da-4164-9450-46b2df961183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:47.002649 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba20202-558a-4368-bcfb-859089b95cce None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:47.004019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-cba20202-558a-4368-bcfb-859089b95cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:47.037593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:47.069260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989cfb-26da-4164-9450-46b2df961183 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:47.074052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfba36-a182-4971-b36b-60188d970a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:47.074751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfba36-a182-4971-b36b-60188d970a89 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.075038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfba36-a182-4971-b36b-60188d970a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.075441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfba36-a182-4971-b36b-60188d970a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.078408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba20202-558a-4368-bcfb-859089b95cce None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:47.083794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:47.084443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.084753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.085049 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] PATH_INFO: `/v3/projects/f2ac265cb95c4775892dd5383de6f0ab` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.086172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ac265cb95c4775892dd5383de6f0ab)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:47.087463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfba36-a182-4971-b36b-60188d970a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:47.088680 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:47.091151 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfba36-a182-4971-b36b-60188d970a89 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:47.103500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1283/2531] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:47.164050 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfba36-a182-4971-b36b-60188d970a89 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:47.174312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfba36-a182-4971-b36b-60188d970a89 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:47.178353 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ac0e5-79aa-474b-9ab8-b0067f26ee74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:47.179154 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ac0e5-79aa-474b-9ab8-b0067f26ee74 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.179575 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ac0e5-79aa-474b-9ab8-b0067f26ee74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.180038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ac0e5-79aa-474b-9ab8-b0067f26ee74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.182780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f04ac0e5-79aa-474b-9ab8-b0067f26ee74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:47.201386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ac265cb95c4775892dd5383de6f0ab', 'request_id': 'req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:47.241715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:47.262921 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ac0e5-79aa-474b-9ab8-b0067f26ee74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:47.264976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ac0e5-79aa-474b-9ab8-b0067f26ee74 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:47.266658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ac265cb95c4775892dd5383de6f0ab', 'request_id': 'req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:47.272781 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ac265cb95c4775892dd5383de6f0ab', 'request_id': 'req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:47.286520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1284/2532] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:53:47.298485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] The token cache is being invalidate because project f2ac265cb95c4775892dd5383de6f0ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:47.298807 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:47.299664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:47.303700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1249/2533] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:47 2022] DELETE /identity/v3/projects/f2ac265cb95c4775892dd5383de6f0ab => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:47.312684 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ac0e5-79aa-474b-9ab8-b0067f26ee74 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:47.328291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ac0e5-79aa-474b-9ab8-b0067f26ee74 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:47.397504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:47.398317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.398608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.398887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] PATH_INFO: `/v3/users/39ebdd5623a540079b4909e1724e8eee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.400224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ebdd5623a540079b4909e1724e8eee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:47.403659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:47.606116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ebdd5623a540079b4909e1724e8eee'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:47.606750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ebdd5623a540079b4909e1724e8eee'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:47.614371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ebdd5623a540079b4909e1724e8eee'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:47.629380 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ebdd5623a540079b4909e1724e8eee'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:47.712398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ebdd5623a540079b4909e1724e8eee'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:47.719708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1285/2534] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:47 2022] DELETE /identity/v3/users/39ebdd5623a540079b4909e1724e8eee => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:48.255272 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:48.256890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:48.272291 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d152cd-9122-45b4-91b8-a4b9ee18ecc3 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:48.341852 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:48.342681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:48.343075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:48.343379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] PATH_INFO: `/v3/projects/1cb72526009c41718c910a825a841b4d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:48.344809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb72526009c41718c910a825a841b4d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:48.347148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:48.449974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb72526009c41718c910a825a841b4d', 'request_id': 'req-a78106f3-e323-4cb6-b41b-6df94a99a595'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:48.561770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb72526009c41718c910a825a841b4d', 'request_id': 'req-a78106f3-e323-4cb6-b41b-6df94a99a595'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:48.563472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:48.568880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb72526009c41718c910a825a841b4d', 'request_id': 'req-a78106f3-e323-4cb6-b41b-6df94a99a595'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:48.581722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] The token cache is being invalidate because project 1cb72526009c41718c910a825a841b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:48.582031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:48.582715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:48.584310 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1250/2535] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:48 2022] DELETE /identity/v3/projects/1cb72526009c41718c910a825a841b4d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:48.588864 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:48.590585 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:48.603476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebd9e8-3b63-459c-b905-d3651dfddef1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:48.662507 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:48.663167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:48.663451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:48.663724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] PATH_INFO: `/v3/users/af22ca613aa84aa8a29b5c868a2379c6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:48.664836 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af22ca613aa84aa8a29b5c868a2379c6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:48.666786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:48.668271 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:49.091937 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af22ca613aa84aa8a29b5c868a2379c6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:49.092615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af22ca613aa84aa8a29b5c868a2379c6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:49.099418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af22ca613aa84aa8a29b5c868a2379c6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:49.111406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af22ca613aa84aa8a29b5c868a2379c6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:49.221065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-10bcc4f5-07a1-45e6-8335-ddc7dc00985a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af22ca613aa84aa8a29b5c868a2379c6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:49.230159 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1286/2536] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:48 2022] DELETE /identity/v3/users/af22ca613aa84aa8a29b5c868a2379c6 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:49.709866 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:49.711460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:49.727212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78106f3-e323-4cb6-b41b-6df94a99a595 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:49.810957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:49.811654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:49.811938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:49.812217 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] PATH_INFO: `/v3/projects/992e77db612942e292dc5b7acd7c85bb` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:49.813487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=992e77db612942e292dc5b7acd7c85bb)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:49.815483 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:49.925260 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992e77db612942e292dc5b7acd7c85bb', 'request_id': 'req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.014804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992e77db612942e292dc5b7acd7c85bb', 'request_id': 'req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.022287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992e77db612942e292dc5b7acd7c85bb', 'request_id': 'req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.034222 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] The token cache is being invalidate because project 992e77db612942e292dc5b7acd7c85bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:50.034522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.035290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-cadb4f90-2fad-4bda-96e6-5f2af44afcfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.037187 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1251/2537] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:49 2022] DELETE /identity/v3/projects/992e77db612942e292dc5b7acd7c85bb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:50.043177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38412968-3502-4a33-8667-adabd6800675 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:50.043689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38412968-3502-4a33-8667-adabd6800675 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:50.043803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38412968-3502-4a33-8667-adabd6800675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:50.063634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-38412968-3502-4a33-8667-adabd6800675 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:50.064881 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-38412968-3502-4a33-8667-adabd6800675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:50.141892 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1287/2538] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:50.144064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ca23-b986-4d33-9ca6-e224787141e5 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:50.144441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ca23-b986-4d33-9ca6-e224787141e5 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:50.144780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ca23-b986-4d33-9ca6-e224787141e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:50.168167 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-0d06ca23-b986-4d33-9ca6-e224787141e5 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:50.169933 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0d06ca23-b986-4d33-9ca6-e224787141e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:50.178344 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1252/2539] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:50.182993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38412968-3502-4a33-8667-adabd6800675 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:50.193404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38412968-3502-4a33-8667-adabd6800675 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:50.198629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a84b3-44f6-4ac1-9a7a-31bc55cdd496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:50.199280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a84b3-44f6-4ac1-9a7a-31bc55cdd496 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:50.199676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a84b3-44f6-4ac1-9a7a-31bc55cdd496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:50.199966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a84b3-44f6-4ac1-9a7a-31bc55cdd496 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:50.200644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a84b3-44f6-4ac1-9a7a-31bc55cdd496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:50.200952 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a84b3-44f6-4ac1-9a7a-31bc55cdd496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:50.202613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a84b3-44f6-4ac1-9a7a-31bc55cdd496 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:50.214703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1288/2540] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:53:50.220522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06ca23-b986-4d33-9ca6-e224787141e5 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:50.230111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06ca23-b986-4d33-9ca6-e224787141e5 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:50.234931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f34cdb-45b5-49c1-9825-e7976d6c5f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:50.235535 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f34cdb-45b5-49c1-9825-e7976d6c5f23 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:50.235817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f34cdb-45b5-49c1-9825-e7976d6c5f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:50.236116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f34cdb-45b5-49c1-9825-e7976d6c5f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:50.236750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f34cdb-45b5-49c1-9825-e7976d6c5f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:50.238727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f34cdb-45b5-49c1-9825-e7976d6c5f23 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:50.392459 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1253/2541] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:50 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:50.397623 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a84b3-44f6-4ac1-9a7a-31bc55cdd496 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:50.410308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a84b3-44f6-4ac1-9a7a-31bc55cdd496 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:50.472423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97c4a4-a71c-406c-a2fe-619afcc2638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:50.473102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97c4a4-a71c-406c-a2fe-619afcc2638a admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:50.473369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97c4a4-a71c-406c-a2fe-619afcc2638a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:50.473647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97c4a4-a71c-406c-a2fe-619afcc2638a admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:50.474478 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97c4a4-a71c-406c-a2fe-619afcc2638a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:50.476565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97c4a4-a71c-406c-a2fe-619afcc2638a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:50.488650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:50.577402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1289/2542] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:50 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:50.580257 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f34cdb-45b5-49c1-9825-e7976d6c5f23 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:50.593072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f34cdb-45b5-49c1-9825-e7976d6c5f23 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:50.597896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb6bd1-d6ce-4d12-b7ca-4aab8801dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:50.598528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb6bd1-d6ce-4d12-b7ca-4aab8801dffb admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:50.598788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb6bd1-d6ce-4d12-b7ca-4aab8801dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:50.599069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb6bd1-d6ce-4d12-b7ca-4aab8801dffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:50.599734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb6bd1-d6ce-4d12-b7ca-4aab8801dffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:50.601315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb6bd1-d6ce-4d12-b7ca-4aab8801dffb admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:50.612614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1254/2543] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:50.616567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97c4a4-a71c-406c-a2fe-619afcc2638a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:50.626898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97c4a4-a71c-406c-a2fe-619afcc2638a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:50.631899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ae1c6-ada0-4884-8e12-3bd2a9f02814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:50.632517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ae1c6-ada0-4884-8e12-3bd2a9f02814 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:50.632806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ae1c6-ada0-4884-8e12-3bd2a9f02814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:50.633137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ae1c6-ada0-4884-8e12-3bd2a9f02814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:50.633822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ae1c6-ada0-4884-8e12-3bd2a9f02814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:50.636144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ae1c6-ada0-4884-8e12-3bd2a9f02814 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:50.647101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1290/2544] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:50.652054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb6bd1-d6ce-4d12-b7ca-4aab8801dffb admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:50.663203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb6bd1-d6ce-4d12-b7ca-4aab8801dffb admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:50.669766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e2a0e-fe65-4982-b183-56b2426a1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:50.670465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2a0e-fe65-4982-b183-56b2426a1cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:50.670773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2a0e-fe65-4982-b183-56b2426a1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:50.671052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2a0e-fe65-4982-b183-56b2426a1cbe admin admin] PATH_INFO: `/v3/projects/bb31b2d0114945949d98fd6c31da4ccd/users/7b844a8f329f42e291baa81d53e6c2c2/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:50.686702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e2a0e-fe65-4982-b183-56b2426a1cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb31b2d0114945949d98fd6c31da4ccd, user_id=7b844a8f329f42e291baa81d53e6c2c2, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:50.689408 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e2a0e-fe65-4982-b183-56b2426a1cbe admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:50.771081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1255/2545] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:50 2022] PUT /identity/v3/projects/bb31b2d0114945949d98fd6c31da4ccd/users/7b844a8f329f42e291baa81d53e6c2c2/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:50.781669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00b42-92a5-49b1-ab8f-d77477577f4e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:50.782181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00b42-92a5-49b1-ab8f-d77477577f4e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:50.782697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00b42-92a5-49b1-ab8f-d77477577f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:50.817114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-eea00b42-92a5-49b1-ab8f-d77477577f4e None None] MFA Rules not processed for user `7b844a8f329f42e291baa81d53e6c2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:50.818409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-eea00b42-92a5-49b1-ab8f-d77477577f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:50.892685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1291/2546] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:51.018876 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e2a0e-fe65-4982-b183-56b2426a1cbe admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:51.020832 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ab8e2a0e-fe65-4982-b183-56b2426a1cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:51.035341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:51.081711 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e2a0e-fe65-4982-b183-56b2426a1cbe admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:51.085473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81552fd-561d-47db-93c6-583e12ece47f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:51.086828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81552fd-561d-47db-93c6-583e12ece47f service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.086828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81552fd-561d-47db-93c6-583e12ece47f service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.086828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81552fd-561d-47db-93c6-583e12ece47f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.095696 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81552fd-561d-47db-93c6-583e12ece47f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:51.097129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81552fd-561d-47db-93c6-583e12ece47f service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:51.105968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1256/2547] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:51.133110 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00b42-92a5-49b1-ab8f-d77477577f4e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:51.222880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00b42-92a5-49b1-ab8f-d77477577f4e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:51.227427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:51.228054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.228337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.228614 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] PATH_INFO: `/v3/users/7b844a8f329f42e291baa81d53e6c2c2` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.230742 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b844a8f329f42e291baa81d53e6c2c2)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:51.232786 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:51.449510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b844a8f329f42e291baa81d53e6c2c2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:51.450311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b844a8f329f42e291baa81d53e6c2c2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:51.458233 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b844a8f329f42e291baa81d53e6c2c2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:51.473870 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b844a8f329f42e291baa81d53e6c2c2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:51.477995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:51.626350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b844a8f329f42e291baa81d53e6c2c2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:51.632976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1292/2548] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:51 2022] DELETE /identity/v3/users/7b844a8f329f42e291baa81d53e6c2c2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:51.637473 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef068491-5d19-4f93-a208-04d6ebc5dce1 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.637765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef068491-5d19-4f93-a208-04d6ebc5dce1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.638068 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef068491-5d19-4f93-a208-04d6ebc5dce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.657243 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ef068491-5d19-4f93-a208-04d6ebc5dce1 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:51.658595 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ef068491-5d19-4f93-a208-04d6ebc5dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:51.718335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1257/2549] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:51.728039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:51.730132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:51.788959 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd800adc-9362-485f-aa0b-d22f36878e81 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:51.793427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fdae8-2fe5-4a41-b691-bd75cd59e633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:51.794041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fdae8-2fe5-4a41-b691-bd75cd59e633 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.794362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fdae8-2fe5-4a41-b691-bd75cd59e633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.794644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fdae8-2fe5-4a41-b691-bd75cd59e633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.803654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fdae8-2fe5-4a41-b691-bd75cd59e633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:51.805095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fdae8-2fe5-4a41-b691-bd75cd59e633 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:51.814504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1293/2550] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:52.366209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef068491-5d19-4f93-a208-04d6ebc5dce1 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:52.367666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ef068491-5d19-4f93-a208-04d6ebc5dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:52.380159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef068491-5d19-4f93-a208-04d6ebc5dce1 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:52.384908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:52.385700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:52.386329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:52.386329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] PATH_INFO: `/v3/projects/bb31b2d0114945949d98fd6c31da4ccd` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:52.387470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb31b2d0114945949d98fd6c31da4ccd)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:52.389645 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:52.521676 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb31b2d0114945949d98fd6c31da4ccd', 'request_id': 'req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:52.598073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb31b2d0114945949d98fd6c31da4ccd', 'request_id': 'req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:52.605089 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb31b2d0114945949d98fd6c31da4ccd', 'request_id': 'req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:52.616325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] The token cache is being invalidate because project bb31b2d0114945949d98fd6c31da4ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:52.616556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:52.617191 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7db61c9c-1cb8-47e5-9b8b-443068b83c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:52.618705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1258/2551] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:52 2022] DELETE /identity/v3/projects/bb31b2d0114945949d98fd6c31da4ccd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:52.623685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4d10-185c-422e-8791-8954153e006e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:52.624160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4d10-185c-422e-8791-8954153e006e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:52.624276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4d10-185c-422e-8791-8954153e006e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:52.643859 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e90a4d10-185c-422e-8791-8954153e006e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:52.645076 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e90a4d10-185c-422e-8791-8954153e006e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:52.709242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1294/2552] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:52.717741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e4195-8225-4445-a20b-be618f588952 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:52.718296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e4195-8225-4445-a20b-be618f588952 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:52.718663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e4195-8225-4445-a20b-be618f588952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:52.742823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ba6e4195-8225-4445-a20b-be618f588952 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:52.744235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ba6e4195-8225-4445-a20b-be618f588952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:52.754333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1259/2553] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:52.758791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4d10-185c-422e-8791-8954153e006e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:52.768840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4d10-185c-422e-8791-8954153e006e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:52.774223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95902d68-e8e8-4361-8a0e-05d162255f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:52.774972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95902d68-e8e8-4361-8a0e-05d162255f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:52.775276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95902d68-e8e8-4361-8a0e-05d162255f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:52.775667 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95902d68-e8e8-4361-8a0e-05d162255f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:52.776578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95902d68-e8e8-4361-8a0e-05d162255f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:52.776876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95902d68-e8e8-4361-8a0e-05d162255f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:52.778985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95902d68-e8e8-4361-8a0e-05d162255f0c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:52.792933 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1295/2554] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:52.797349 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e4195-8225-4445-a20b-be618f588952 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:52.807232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e4195-8225-4445-a20b-be618f588952 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:52.812551 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda2f5-0cf5-4c2c-a30e-3d60ed5459f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:52.813262 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda2f5-0cf5-4c2c-a30e-3d60ed5459f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:52.813566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda2f5-0cf5-4c2c-a30e-3d60ed5459f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:52.813853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda2f5-0cf5-4c2c-a30e-3d60ed5459f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:52.814521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cda2f5-0cf5-4c2c-a30e-3d60ed5459f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:52.816553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cda2f5-0cf5-4c2c-a30e-3d60ed5459f6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:52.919775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1260/2555] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:52 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:52.924294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95902d68-e8e8-4361-8a0e-05d162255f0c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:52.934851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95902d68-e8e8-4361-8a0e-05d162255f0c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:52.991230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe895de-f4fc-44a1-beb3-216309fa58a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:52.991840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe895de-f4fc-44a1-beb3-216309fa58a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:52.992124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe895de-f4fc-44a1-beb3-216309fa58a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:52.992403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe895de-f4fc-44a1-beb3-216309fa58a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:52.993022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe895de-f4fc-44a1-beb3-216309fa58a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:52.995683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe895de-f4fc-44a1-beb3-216309fa58a1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:53.101389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1296/2556] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:52 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:53.106320 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda2f5-0cf5-4c2c-a30e-3d60ed5459f6 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:53.117131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda2f5-0cf5-4c2c-a30e-3d60ed5459f6 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:53.122401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfba6cb-cd72-4e8a-bfa4-c1bd158cdd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:53.123006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfba6cb-cd72-4e8a-bfa4-c1bd158cdd8f admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:53.123291 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfba6cb-cd72-4e8a-bfa4-c1bd158cdd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:53.123570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfba6cb-cd72-4e8a-bfa4-c1bd158cdd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:53.124218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfba6cb-cd72-4e8a-bfa4-c1bd158cdd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:53.125863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfba6cb-cd72-4e8a-bfa4-c1bd158cdd8f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:53.128058 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:53.136558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1261/2557] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:53.140768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe895de-f4fc-44a1-beb3-216309fa58a1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:53.152524 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe895de-f4fc-44a1-beb3-216309fa58a1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:53.157473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e5df8-ad60-4f8a-8754-d2595f843a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:53.158083 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5df8-ad60-4f8a-8754-d2595f843a2a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:53.158419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5df8-ad60-4f8a-8754-d2595f843a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:53.158699 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5df8-ad60-4f8a-8754-d2595f843a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:53.159326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e5df8-ad60-4f8a-8754-d2595f843a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:53.160934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e5df8-ad60-4f8a-8754-d2595f843a2a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:53.176558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1297/2558] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:53.177923 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfba6cb-cd72-4e8a-bfa4-c1bd158cdd8f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:53.188246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfba6cb-cd72-4e8a-bfa4-c1bd158cdd8f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:53.193315 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cec84f-c266-4414-a9aa-3d9ebd4b8c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:53.194129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cec84f-c266-4414-a9aa-3d9ebd4b8c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:53.194487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cec84f-c266-4414-a9aa-3d9ebd4b8c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:53.194745 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cec84f-c266-4414-a9aa-3d9ebd4b8c55 admin admin] PATH_INFO: `/v3/projects/1f03e35cf8084c9fb558ebd5786c3abc/users/5fdc613ade9b400f8ff68c5a46fd9dd0/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:53.210475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cec84f-c266-4414-a9aa-3d9ebd4b8c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f03e35cf8084c9fb558ebd5786c3abc, user_id=5fdc613ade9b400f8ff68c5a46fd9dd0, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:53.213130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cec84f-c266-4414-a9aa-3d9ebd4b8c55 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:53.279250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1262/2559] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:53 2022] PUT /identity/v3/projects/1f03e35cf8084c9fb558ebd5786c3abc/users/5fdc613ade9b400f8ff68c5a46fd9dd0/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:53.290378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47c37-9c22-4527-bec7-5e5f3cd6f3e9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:53.290717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47c37-9c22-4527-bec7-5e5f3cd6f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:53.290980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47c37-9c22-4527-bec7-5e5f3cd6f3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:53.299717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:53.321094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-58d47c37-9c22-4527-bec7-5e5f3cd6f3e9 None None] MFA Rules not processed for user `5fdc613ade9b400f8ff68c5a46fd9dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:53.322515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-58d47c37-9c22-4527-bec7-5e5f3cd6f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:53.390153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1298/2560] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:53:53.402672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cec84f-c266-4414-a9aa-3d9ebd4b8c55 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:53.404536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-16cec84f-c266-4414-a9aa-3d9ebd4b8c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:53.467076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cec84f-c266-4414-a9aa-3d9ebd4b8c55 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:53.470983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d70fc4-e4c8-40f1-a2fe-8afa2aa8a477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:53.474823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d70fc4-e4c8-40f1-a2fe-8afa2aa8a477 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:53.474823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d70fc4-e4c8-40f1-a2fe-8afa2aa8a477 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:53.474823 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d70fc4-e4c8-40f1-a2fe-8afa2aa8a477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:53.481640 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d70fc4-e4c8-40f1-a2fe-8afa2aa8a477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:53.483254 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d70fc4-e4c8-40f1-a2fe-8afa2aa8a477 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:53.492463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1263/2561] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:53.997718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d47c37-9c22-4527-bec7-5e5f3cd6f3e9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:53.999426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-58d47c37-9c22-4527-bec7-5e5f3cd6f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:54.067186 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d47c37-9c22-4527-bec7-5e5f3cd6f3e9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:54.071916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:54.072579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:54.072919 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:54.073180 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] PATH_INFO: `/v3/users/af959a14069b4a9590a566024346eb61` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:54.075789 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=af959a14069b4a9590a566024346eb61)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:54.078307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:54.285323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af959a14069b4a9590a566024346eb61'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:54.286033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af959a14069b4a9590a566024346eb61'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:54.293986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af959a14069b4a9590a566024346eb61'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:54.305915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af959a14069b4a9590a566024346eb61'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:54.386270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af959a14069b4a9590a566024346eb61'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:54.392715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1299/2562] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:53 2022] DELETE /identity/v3/users/af959a14069b4a9590a566024346eb61 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:54.397197 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c846e9a-2cfd-40f1-a931-23129380b2eb None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:54.397481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c846e9a-2cfd-40f1-a931-23129380b2eb None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:54.397753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c846e9a-2cfd-40f1-a931-23129380b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:54.418520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6c846e9a-2cfd-40f1-a931-23129380b2eb None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:54.419719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6c846e9a-2cfd-40f1-a931-23129380b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:54.483567 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1264/2563] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:54.495541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:54.497069 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:54.511187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:54.561581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1e9f6-6cfe-40ab-961e-61ac94e383eb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:54.565669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2408e4-42c6-4ecf-b455-4313fe03871b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:54.566275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2408e4-42c6-4ecf-b455-4313fe03871b service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:54.566582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2408e4-42c6-4ecf-b455-4313fe03871b service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:54.566883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2408e4-42c6-4ecf-b455-4313fe03871b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:54.577034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2408e4-42c6-4ecf-b455-4313fe03871b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:54.578312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2408e4-42c6-4ecf-b455-4313fe03871b service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:54.588963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1300/2564] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:55.062491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c846e9a-2cfd-40f1-a931-23129380b2eb None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:55.063993 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6c846e9a-2cfd-40f1-a931-23129380b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:55.115830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c846e9a-2cfd-40f1-a931-23129380b2eb None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:55.115830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:55.115830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:55.115830 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:55.116607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] PATH_INFO: `/v3/projects/e2b66d029d4f4086973a70e7da28ec9b` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:55.116607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b66d029d4f4086973a70e7da28ec9b)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:55.116607 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:55.296723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b66d029d4f4086973a70e7da28ec9b', 'request_id': 'req-554dc0a2-82e6-4e7b-b37d-a108423039af'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:55.367486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b66d029d4f4086973a70e7da28ec9b', 'request_id': 'req-554dc0a2-82e6-4e7b-b37d-a108423039af'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:55.373531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b66d029d4f4086973a70e7da28ec9b', 'request_id': 'req-554dc0a2-82e6-4e7b-b37d-a108423039af'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:55.381526 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:55.385725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] The token cache is being invalidate because project e2b66d029d4f4086973a70e7da28ec9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:55.386019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:55.386701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:55.388198 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1265/2565] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:55 2022] DELETE /identity/v3/projects/e2b66d029d4f4086973a70e7da28ec9b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:55.392384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2408e4-42c6-4ecf-b455-4313fe03871b service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:55.403294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2408e4-42c6-4ecf-b455-4313fe03871b service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:55.461241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:55.461796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:55.462080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:55.462387 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] PATH_INFO: `/v3/users/7ce89bec1bca482fa71f972dbec7982a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:55.464063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce89bec1bca482fa71f972dbec7982a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:55.466270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:55.684909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce89bec1bca482fa71f972dbec7982a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:55.685590 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce89bec1bca482fa71f972dbec7982a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:55.692386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce89bec1bca482fa71f972dbec7982a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:55.704144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce89bec1bca482fa71f972dbec7982a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:55.784558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6c4c3319-a732-4f16-90b6-25ba7d63ea98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce89bec1bca482fa71f972dbec7982a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:55.790807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1301/2566] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:55 2022] DELETE /identity/v3/users/7ce89bec1bca482fa71f972dbec7982a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:56.308592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:56.310099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:56.323185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dc0a2-82e6-4e7b-b37d-a108423039af admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:56.385054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:56.386324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:56.386605 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:56.386877 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] PATH_INFO: `/v3/projects/8fdbe1f6dd17417fafd5a2204301ba9a` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:56.388005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fdbe1f6dd17417fafd5a2204301ba9a)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:56.389912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:56.523206 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fdbe1f6dd17417fafd5a2204301ba9a', 'request_id': 'req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:56.695048 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fdbe1f6dd17417fafd5a2204301ba9a', 'request_id': 'req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:56.702517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fdbe1f6dd17417fafd5a2204301ba9a', 'request_id': 'req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:56.715859 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] The token cache is being invalidate because project 8fdbe1f6dd17417fafd5a2204301ba9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:56.716184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:56.716831 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa455bf8-0c7f-4d2e-8fb1-82b9fbe09091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:56.718342 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1266/2567] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:56 2022] DELETE /identity/v3/projects/8fdbe1f6dd17417fafd5a2204301ba9a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:56.723203 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e5fec-3293-4159-b394-e615ae249cb0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:56.723665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e5fec-3293-4159-b394-e615ae249cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:56.723761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e5fec-3293-4159-b394-e615ae249cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:56.743508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-643e5fec-3293-4159-b394-e615ae249cb0 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:56.745556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-643e5fec-3293-4159-b394-e615ae249cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:56.773929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:56.804334 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1302/2568] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:56.813535 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008d57-f329-4256-b05c-1d60f129d2ae None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:56.813821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008d57-f329-4256-b05c-1d60f129d2ae None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:56.814099 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008d57-f329-4256-b05c-1d60f129d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:56.833570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ca008d57-f329-4256-b05c-1d60f129d2ae None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:56.834856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ca008d57-f329-4256-b05c-1d60f129d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:56.843540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1267/2569] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:56.854588 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e5fec-3293-4159-b394-e615ae249cb0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:56.864381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e5fec-3293-4159-b394-e615ae249cb0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:56.869052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde1b73-3d45-446d-823a-a482aad5fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:56.869685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde1b73-3d45-446d-823a-a482aad5fc3e admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:56.869980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde1b73-3d45-446d-823a-a482aad5fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:56.870290 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde1b73-3d45-446d-823a-a482aad5fc3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:56.870938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde1b73-3d45-446d-823a-a482aad5fc3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:56.871263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde1b73-3d45-446d-823a-a482aad5fc3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:56.872876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde1b73-3d45-446d-823a-a482aad5fc3e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:56.884193 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1303/2570] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:56.888633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca008d57-f329-4256-b05c-1d60f129d2ae None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:56.897664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca008d57-f329-4256-b05c-1d60f129d2ae None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:56.903198 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff15d1-5197-467e-aa6b-16ff0e96102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:56.903858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff15d1-5197-467e-aa6b-16ff0e96102b admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:56.904139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff15d1-5197-467e-aa6b-16ff0e96102b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:56.904439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff15d1-5197-467e-aa6b-16ff0e96102b admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:56.905072 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff15d1-5197-467e-aa6b-16ff0e96102b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:56.907057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff15d1-5197-467e-aa6b-16ff0e96102b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:57.022012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1268/2571] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:56 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:57.026610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde1b73-3d45-446d-823a-a482aad5fc3e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:57.036510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde1b73-3d45-446d-823a-a482aad5fc3e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:57.093521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7018b4-915f-4101-bae3-0d0bec85193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:57.094153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7018b4-915f-4101-bae3-0d0bec85193e admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.094466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7018b4-915f-4101-bae3-0d0bec85193e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.094740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7018b4-915f-4101-bae3-0d0bec85193e admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.095394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7018b4-915f-4101-bae3-0d0bec85193e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:57.097291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7018b4-915f-4101-bae3-0d0bec85193e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:57.190878 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1304/2572] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:57 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:57.194985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff15d1-5197-467e-aa6b-16ff0e96102b admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:57.205481 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff15d1-5197-467e-aa6b-16ff0e96102b admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:57.210418 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043a6c2-e298-46e7-bb2d-504570cd3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:57.211024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043a6c2-e298-46e7-bb2d-504570cd3985 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.211307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043a6c2-e298-46e7-bb2d-504570cd3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.211581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043a6c2-e298-46e7-bb2d-504570cd3985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.212226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043a6c2-e298-46e7-bb2d-504570cd3985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:57.213847 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043a6c2-e298-46e7-bb2d-504570cd3985 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:57.225834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1269/2573] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:57.232794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7018b4-915f-4101-bae3-0d0bec85193e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:57.243028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7018b4-915f-4101-bae3-0d0bec85193e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:57.249540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3c823-71c7-4f21-9f4b-2e514269f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:57.250147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3c823-71c7-4f21-9f4b-2e514269f70a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.250460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3c823-71c7-4f21-9f4b-2e514269f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.250733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3c823-71c7-4f21-9f4b-2e514269f70a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.251373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3c823-71c7-4f21-9f4b-2e514269f70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:57.252994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3c823-71c7-4f21-9f4b-2e514269f70a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:57.264545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1305/2574] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:57.268675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043a6c2-e298-46e7-bb2d-504570cd3985 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:57.278920 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043a6c2-e298-46e7-bb2d-504570cd3985 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:57.283445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2f9c8-f970-4f20-8a8b-44d413275600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:57.284084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2f9c8-f970-4f20-8a8b-44d413275600 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.284368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2f9c8-f970-4f20-8a8b-44d413275600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.284664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2f9c8-f970-4f20-8a8b-44d413275600 admin admin] PATH_INFO: `/v3/projects/eb4a935e3bbb4effa7b1ea383df40236/users/a9fb4cdcd1b44197b054bde22d733ee8/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.313065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2f9c8-f970-4f20-8a8b-44d413275600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4a935e3bbb4effa7b1ea383df40236, user_id=a9fb4cdcd1b44197b054bde22d733ee8, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:57.313065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2f9c8-f970-4f20-8a8b-44d413275600 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:57.470625 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1270/2575] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:57 2022] PUT /identity/v3/projects/eb4a935e3bbb4effa7b1ea383df40236/users/a9fb4cdcd1b44197b054bde22d733ee8/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:57.474306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456197-b527-4d21-a945-93d1a5d7dfe1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.474597 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456197-b527-4d21-a945-93d1a5d7dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.474875 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456197-b527-4d21-a945-93d1a5d7dfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.506291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-de456197-b527-4d21-a945-93d1a5d7dfe1 None None] MFA Rules not processed for user `a9fb4cdcd1b44197b054bde22d733ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:57.507515 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-de456197-b527-4d21-a945-93d1a5d7dfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:57.575545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1306/2576] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:57.586998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2f9c8-f970-4f20-8a8b-44d413275600 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:57.588731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e8b2f9c8-f970-4f20-8a8b-44d413275600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:57.621779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:57.652647 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2f9c8-f970-4f20-8a8b-44d413275600 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:57.656358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80af39-55d3-4fa0-b531-502b9ca0bc2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:57.656973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80af39-55d3-4fa0-b531-502b9ca0bc2f service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.657253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80af39-55d3-4fa0-b531-502b9ca0bc2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.657528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80af39-55d3-4fa0-b531-502b9ca0bc2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.665778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80af39-55d3-4fa0-b531-502b9ca0bc2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:57.667446 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80af39-55d3-4fa0-b531-502b9ca0bc2f service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:57.676606 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1271/2577] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:57.696685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de456197-b527-4d21-a945-93d1a5d7dfe1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:57.729284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:57.762094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de456197-b527-4d21-a945-93d1a5d7dfe1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:57.766899 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:57.767560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.767839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.768112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] PATH_INFO: `/v3/users/a9fb4cdcd1b44197b054bde22d733ee8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.769246 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fb4cdcd1b44197b054bde22d733ee8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:57.771172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:58.034642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fb4cdcd1b44197b054bde22d733ee8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.035219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fb4cdcd1b44197b054bde22d733ee8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.042535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fb4cdcd1b44197b054bde22d733ee8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.054037 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fb4cdcd1b44197b054bde22d733ee8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.123004 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fb4cdcd1b44197b054bde22d733ee8'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.129406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1307/2578] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:57 2022] DELETE /identity/v3/users/a9fb4cdcd1b44197b054bde22d733ee8 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:58.133881 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21658f8-102b-45b0-9ef9-f20d33483076 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:58.134172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21658f8-102b-45b0-9ef9-f20d33483076 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:58.134512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21658f8-102b-45b0-9ef9-f20d33483076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:58.154938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-d21658f8-102b-45b0-9ef9-f20d33483076 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:58.156171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d21658f8-102b-45b0-9ef9-f20d33483076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:58.221147 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1272/2579] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:58.231505 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:58.232885 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:58.290391 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afc924-a05d-4735-96dd-edf07114a874 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:58.294956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4ff3e-6ff4-4815-b1a4-0364ad86d77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:58.295556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4ff3e-6ff4-4815-b1a4-0364ad86d77c service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:58.295837 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4ff3e-6ff4-4815-b1a4-0364ad86d77c service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:58.296136 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4ff3e-6ff4-4815-b1a4-0364ad86d77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:58.304848 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4ff3e-6ff4-4815-b1a4-0364ad86d77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:58.306309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4ff3e-6ff4-4815-b1a4-0364ad86d77c service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:58.317378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1308/2580] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:58.725285 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21658f8-102b-45b0-9ef9-f20d33483076 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:58.726845 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d21658f8-102b-45b0-9ef9-f20d33483076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:58.744092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21658f8-102b-45b0-9ef9-f20d33483076 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:58.749516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:58.750162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:58.750484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:58.750766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] PATH_INFO: `/v3/projects/eb4a935e3bbb4effa7b1ea383df40236` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:58.752004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4a935e3bbb4effa7b1ea383df40236)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:58.753898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:58.895531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4a935e3bbb4effa7b1ea383df40236', 'request_id': 'req-b1c6535d-7503-46c2-9cb9-910043f5443b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.968872 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4a935e3bbb4effa7b1ea383df40236', 'request_id': 'req-b1c6535d-7503-46c2-9cb9-910043f5443b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.976250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4a935e3bbb4effa7b1ea383df40236', 'request_id': 'req-b1c6535d-7503-46c2-9cb9-910043f5443b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.988007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] The token cache is being invalidate because project eb4a935e3bbb4effa7b1ea383df40236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:58.988299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.989084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b1c6535d-7503-46c2-9cb9-910043f5443b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.990601 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1273/2581] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:58 2022] DELETE /identity/v3/projects/eb4a935e3bbb4effa7b1ea383df40236 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:58.996398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e57f2-917d-4884-a1f5-d12c28dc1605 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:58.996896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e57f2-917d-4884-a1f5-d12c28dc1605 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:58.996987 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e57f2-917d-4884-a1f5-d12c28dc1605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.016820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b55e57f2-917d-4884-a1f5-d12c28dc1605 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:59.018085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b55e57f2-917d-4884-a1f5-d12c28dc1605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:59.064116 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:59.078604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1309/2582] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:59.086662 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8382127-51a7-4b55-94e3-2476a30d94c3 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.086947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8382127-51a7-4b55-94e3-2476a30d94c3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.087226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8382127-51a7-4b55-94e3-2476a30d94c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.108707 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-a8382127-51a7-4b55-94e3-2476a30d94c3 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:59.109900 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a8382127-51a7-4b55-94e3-2476a30d94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:59.118454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1274/2583] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:59.122911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e57f2-917d-4884-a1f5-d12c28dc1605 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:59.134549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e57f2-917d-4884-a1f5-d12c28dc1605 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:59.139551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1d21d-e6eb-414d-9d20-f73ab060d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:59.140172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1d21d-e6eb-414d-9d20-f73ab060d785 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.140460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1d21d-e6eb-414d-9d20-f73ab060d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.140738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1d21d-e6eb-414d-9d20-f73ab060d785 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.141387 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1d21d-e6eb-414d-9d20-f73ab060d785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:59.141700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1d21d-e6eb-414d-9d20-f73ab060d785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:59.143473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1d21d-e6eb-414d-9d20-f73ab060d785 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:59.156119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1310/2584] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:59.160684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8382127-51a7-4b55-94e3-2476a30d94c3 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:59.175814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8382127-51a7-4b55-94e3-2476a30d94c3 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:59.182717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03495d50-d005-4248-9cbb-cea3832ceebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:59.183346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03495d50-d005-4248-9cbb-cea3832ceebd admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.183698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03495d50-d005-4248-9cbb-cea3832ceebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.183987 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03495d50-d005-4248-9cbb-cea3832ceebd admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.186755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03495d50-d005-4248-9cbb-cea3832ceebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:59.186755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03495d50-d005-4248-9cbb-cea3832ceebd admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:59.321090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1275/2585] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:59 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:59.322174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1d21d-e6eb-414d-9d20-f73ab060d785 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:59.334075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1d21d-e6eb-414d-9d20-f73ab060d785 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:59.395703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54c0a4-fff9-4700-842a-28f2d2bab52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:59.396318 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54c0a4-fff9-4700-842a-28f2d2bab52f admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.396606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54c0a4-fff9-4700-842a-28f2d2bab52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.396883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54c0a4-fff9-4700-842a-28f2d2bab52f admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.397522 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54c0a4-fff9-4700-842a-28f2d2bab52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:59.399529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54c0a4-fff9-4700-842a-28f2d2bab52f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:59.530292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1311/2586] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:59 2022] POST /identity/v3/users => generated 281 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:59.534297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03495d50-d005-4248-9cbb-cea3832ceebd admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:59.544736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03495d50-d005-4248-9cbb-cea3832ceebd admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:59.549284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d45e-969b-4649-9b0c-7a483f79d986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:59.549901 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d45e-969b-4649-9b0c-7a483f79d986 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.550352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d45e-969b-4649-9b0c-7a483f79d986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.550628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d45e-969b-4649-9b0c-7a483f79d986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.556038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7d45e-969b-4649-9b0c-7a483f79d986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:59.556038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7d45e-969b-4649-9b0c-7a483f79d986 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:59.563060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1276/2587] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:59.567103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54c0a4-fff9-4700-842a-28f2d2bab52f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:59.578382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54c0a4-fff9-4700-842a-28f2d2bab52f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:59.595831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262bfc1-3d1d-4caa-b7e2-3c95c1860f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:59.595831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bfc1-3d1d-4caa-b7e2-3c95c1860f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.595831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bfc1-3d1d-4caa-b7e2-3c95c1860f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.595831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bfc1-3d1d-4caa-b7e2-3c95c1860f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.596220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262bfc1-3d1d-4caa-b7e2-3c95c1860f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:59.596220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262bfc1-3d1d-4caa-b7e2-3c95c1860f2f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:59.598539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1312/2588] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:59.603507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d45e-969b-4649-9b0c-7a483f79d986 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:59.613440 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d45e-969b-4649-9b0c-7a483f79d986 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:59.617801 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334b8c-6ce8-452f-ace6-a7eaa1f572a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:59.618506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334b8c-6ce8-452f-ace6-a7eaa1f572a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.618789 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334b8c-6ce8-452f-ace6-a7eaa1f572a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.619064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334b8c-6ce8-452f-ace6-a7eaa1f572a6 admin admin] PATH_INFO: `/v3/projects/11c2ae7c13724e26bd3ea5f3c7319904/users/fb78e983639f44a8a158c2fe6867ad9c/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.635679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:59.639590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c334b8c-6ce8-452f-ace6-a7eaa1f572a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c2ae7c13724e26bd3ea5f3c7319904, user_id=fb78e983639f44a8a158c2fe6867ad9c, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:59.642370 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c334b8c-6ce8-452f-ace6-a7eaa1f572a6 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:59.729580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1277/2589] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:59 2022] PUT /identity/v3/projects/11c2ae7c13724e26bd3ea5f3c7319904/users/fb78e983639f44a8a158c2fe6867ad9c/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:59.740991 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9492da2-537f-4dbb-9f67-0323d8e71f36 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.741276 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9492da2-537f-4dbb-9f67-0323d8e71f36 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.741552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9492da2-537f-4dbb-9f67-0323d8e71f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.771856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d9492da2-537f-4dbb-9f67-0323d8e71f36 None None] MFA Rules not processed for user `fb78e983639f44a8a158c2fe6867ad9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:59.773066 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d9492da2-537f-4dbb-9f67-0323d8e71f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:59.841835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1313/2590] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:59.878426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334b8c-6ce8-452f-ace6-a7eaa1f572a6 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:59.880116 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3c334b8c-6ce8-452f-ace6-a7eaa1f572a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:59.918092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9492da2-537f-4dbb-9f67-0323d8e71f36 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:59.919593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d9492da2-537f-4dbb-9f67-0323d8e71f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:59.947382 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334b8c-6ce8-452f-ace6-a7eaa1f572a6 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:59.951600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9657f-c708-4417-b47a-9532b885865d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:59.952301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9657f-c708-4417-b47a-9532b885865d service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.952587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9657f-c708-4417-b47a-9532b885865d service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.952862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9657f-c708-4417-b47a-9532b885865d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.961947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9657f-c708-4417-b47a-9532b885865d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:59.964092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9657f-c708-4417-b47a-9532b885865d service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:59.974585 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1278/2591] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:59.990289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9657f-c708-4417-b47a-9532b885865d service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:00.000064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9492da2-537f-4dbb-9f67-0323d8e71f36 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.000556 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9657f-c708-4417-b47a-9532b885865d service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.004777 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.005155 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.005467 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.005747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.005862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.006015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] PATH_INFO: `/v3/users/5fdc613ade9b400f8ff68c5a46fd9dd0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.006125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.006331 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] PATH_INFO: `/v3/users/fb78e983639f44a8a158c2fe6867ad9c` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.007209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fdc613ade9b400f8ff68c5a46fd9dd0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.007445 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb78e983639f44a8a158c2fe6867ad9c)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.009225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:00.009353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:00.234426 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb78e983639f44a8a158c2fe6867ad9c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.237741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fdc613ade9b400f8ff68c5a46fd9dd0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.238436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fdc613ade9b400f8ff68c5a46fd9dd0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.246516 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fdc613ade9b400f8ff68c5a46fd9dd0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.247113 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb78e983639f44a8a158c2fe6867ad9c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.258676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fdc613ade9b400f8ff68c5a46fd9dd0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.340778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb78e983639f44a8a158c2fe6867ad9c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.348237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb78e983639f44a8a158c2fe6867ad9c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.348897 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-46d0e629-5d71-409d-bd0a-d0bf78d55c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb78e983639f44a8a158c2fe6867ad9c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.355667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1279/2592] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:59 2022] DELETE /identity/v3/users/fb78e983639f44a8a158c2fe6867ad9c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:00.359945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e76c-8830-40cc-9a13-776614adb4a7 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.360259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e76c-8830-40cc-9a13-776614adb4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.360565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e76c-8830-40cc-9a13-776614adb4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.379714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5233e76c-8830-40cc-9a13-776614adb4a7 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:00.381197 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5233e76c-8830-40cc-9a13-776614adb4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:00.401876 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f9972067-5fec-4641-9527-380658b72527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fdc613ade9b400f8ff68c5a46fd9dd0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.408223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1314/2593] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:59 2022] DELETE /identity/v3/users/5fdc613ade9b400f8ff68c5a46fd9dd0 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:00.412709 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800411fc-7ba8-40eb-9905-d1c780d4a83f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.415803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800411fc-7ba8-40eb-9905-d1c780d4a83f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.415803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800411fc-7ba8-40eb-9905-d1c780d4a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.433830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-800411fc-7ba8-40eb-9905-d1c780d4a83f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:00.435412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-800411fc-7ba8-40eb-9905-d1c780d4a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:00.437127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:00.440936 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1280/2594] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:00.450890 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e76c-8830-40cc-9a13-776614adb4a7 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:00.456092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5233e76c-8830-40cc-9a13-776614adb4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:00.497189 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1315/2595] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:00.507204 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800411fc-7ba8-40eb-9905-d1c780d4a83f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:00.511732 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e76c-8830-40cc-9a13-776614adb4a7 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.562450 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ea431-f92e-4d66-8fbf-b9ab635ed672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.563075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ea431-f92e-4d66-8fbf-b9ab635ed672 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.563355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ea431-f92e-4d66-8fbf-b9ab635ed672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.563627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ea431-f92e-4d66-8fbf-b9ab635ed672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.563741 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800411fc-7ba8-40eb-9905-d1c780d4a83f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.567531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b907857-f914-4264-979c-4e86b4be1d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.568140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b907857-f914-4264-979c-4e86b4be1d4a service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.568426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b907857-f914-4264-979c-4e86b4be1d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.568705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b907857-f914-4264-979c-4e86b4be1d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.572531 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ea431-f92e-4d66-8fbf-b9ab635ed672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.574368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ea431-f92e-4d66-8fbf-b9ab635ed672 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:00.578551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b907857-f914-4264-979c-4e86b4be1d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.580024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b907857-f914-4264-979c-4e86b4be1d4a service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:00.583768 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1281/2596] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:00.593317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1316/2597] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:54:00.700130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:01.392351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ea431-f92e-4d66-8fbf-b9ab635ed672 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.393822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-872ea431-f92e-4d66-8fbf-b9ab635ed672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.406997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ea431-f92e-4d66-8fbf-b9ab635ed672 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.411791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.412428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.412713 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.412996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] PATH_INFO: `/v3/projects/11c2ae7c13724e26bd3ea5f3c7319904` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.414113 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c2ae7c13724e26bd3ea5f3c7319904)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.416389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.435158 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b907857-f914-4264-979c-4e86b4be1d4a service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.436831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5b907857-f914-4264-979c-4e86b4be1d4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.455437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b907857-f914-4264-979c-4e86b4be1d4a service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.460162 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.460799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.461080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.461355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] PATH_INFO: `/v3/projects/1f03e35cf8084c9fb558ebd5786c3abc` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.462540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f03e35cf8084c9fb558ebd5786c3abc)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.465726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.468535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:01.602568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c2ae7c13724e26bd3ea5f3c7319904', 'request_id': 'req-aa25382c-798a-4729-8a42-61dd1b37d749'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.627259 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f03e35cf8084c9fb558ebd5786c3abc', 'request_id': 'req-62b50548-28fc-4d2d-b5fd-796b41d19ef0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.633409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f03e35cf8084c9fb558ebd5786c3abc', 'request_id': 'req-62b50548-28fc-4d2d-b5fd-796b41d19ef0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.706535 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c2ae7c13724e26bd3ea5f3c7319904', 'request_id': 'req-aa25382c-798a-4729-8a42-61dd1b37d749'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.714153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c2ae7c13724e26bd3ea5f3c7319904', 'request_id': 'req-aa25382c-798a-4729-8a42-61dd1b37d749'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.727179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] The token cache is being invalidate because project 11c2ae7c13724e26bd3ea5f3c7319904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:01.727479 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.728170 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-aa25382c-798a-4729-8a42-61dd1b37d749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.730586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1282/2598] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:01 2022] DELETE /identity/v3/projects/11c2ae7c13724e26bd3ea5f3c7319904 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:01.735250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c26cdf-03b3-4eed-92dc-29f5c08e2e82 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.735536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c26cdf-03b3-4eed-92dc-29f5c08e2e82 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.735860 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c26cdf-03b3-4eed-92dc-29f5c08e2e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.756532 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c3c26cdf-03b3-4eed-92dc-29f5c08e2e82 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:01.757744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c3c26cdf-03b3-4eed-92dc-29f5c08e2e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.790802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f03e35cf8084c9fb558ebd5786c3abc', 'request_id': 'req-62b50548-28fc-4d2d-b5fd-796b41d19ef0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.805043 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:01.808733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] The token cache is being invalidate because project 1f03e35cf8084c9fb558ebd5786c3abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:01.809213 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.809922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-62b50548-28fc-4d2d-b5fd-796b41d19ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.812332 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1317/2599] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:01 2022] DELETE /identity/v3/projects/1f03e35cf8084c9fb558ebd5786c3abc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:01.817768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258b54-b434-455a-af2f-9d4ccd824e94 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.818060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258b54-b434-455a-af2f-9d4ccd824e94 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.818389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258b54-b434-455a-af2f-9d4ccd824e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.832779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1283/2600] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:01.840915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-58258b54-b434-455a-af2f-9d4ccd824e94 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:01.841374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84248b16-aaff-4cd5-8e8c-979a60a50b17 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.841815 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84248b16-aaff-4cd5-8e8c-979a60a50b17 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.841994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84248b16-aaff-4cd5-8e8c-979a60a50b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.842521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-58258b54-b434-455a-af2f-9d4ccd824e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.850856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1318/2601] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:01.860126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c08c3-0525-49fe-aa26-39fcbcc0038d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.860126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c08c3-0525-49fe-aa26-39fcbcc0038d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.860436 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c08c3-0525-49fe-aa26-39fcbcc0038d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.863442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-84248b16-aaff-4cd5-8e8c-979a60a50b17 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:01.864659 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-84248b16-aaff-4cd5-8e8c-979a60a50b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.875323 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1284/2602] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:01.884568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a50c08c3-0525-49fe-aa26-39fcbcc0038d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:01.884568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a50c08c3-0525-49fe-aa26-39fcbcc0038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.885858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84248b16-aaff-4cd5-8e8c-979a60a50b17 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.894226 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1319/2603] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:01.896413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84248b16-aaff-4cd5-8e8c-979a60a50b17 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.899268 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c08c3-0525-49fe-aa26-39fcbcc0038d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.905517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eece1c-cb6e-4122-8d31-79a8e638b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.905517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eece1c-cb6e-4122-8d31-79a8e638b02f admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.905517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eece1c-cb6e-4122-8d31-79a8e638b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.905517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eece1c-cb6e-4122-8d31-79a8e638b02f admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.905935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eece1c-cb6e-4122-8d31-79a8e638b02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:01.905935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eece1c-cb6e-4122-8d31-79a8e638b02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.906485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eece1c-cb6e-4122-8d31-79a8e638b02f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.910581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c08c3-0525-49fe-aa26-39fcbcc0038d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.916381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de184f8-d7c7-43ce-a45b-308bcdadf472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.917223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de184f8-d7c7-43ce-a45b-308bcdadf472 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.917589 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de184f8-d7c7-43ce-a45b-308bcdadf472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.917934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de184f8-d7c7-43ce-a45b-308bcdadf472 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.918768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de184f8-d7c7-43ce-a45b-308bcdadf472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:01.919161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de184f8-d7c7-43ce-a45b-308bcdadf472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.920004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1285/2604] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:01.921031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de184f8-d7c7-43ce-a45b-308bcdadf472 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.924363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eece1c-cb6e-4122-8d31-79a8e638b02f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.937577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1320/2605] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:01.937819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eece1c-cb6e-4122-8d31-79a8e638b02f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.939117 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de184f8-d7c7-43ce-a45b-308bcdadf472 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.940312 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec41dd-7fa2-4517-8684-9d43e3891027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.940941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec41dd-7fa2-4517-8684-9d43e3891027 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.941226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec41dd-7fa2-4517-8684-9d43e3891027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.941527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec41dd-7fa2-4517-8684-9d43e3891027 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.942214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec41dd-7fa2-4517-8684-9d43e3891027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.948292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec41dd-7fa2-4517-8684-9d43e3891027 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.951095 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de184f8-d7c7-43ce-a45b-308bcdadf472 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.956430 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fc28b-1b1a-4b21-97a0-ee42d5f72b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.957168 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc28b-1b1a-4b21-97a0-ee42d5f72b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.957521 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc28b-1b1a-4b21-97a0-ee42d5f72b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.957810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc28b-1b1a-4b21-97a0-ee42d5f72b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.958511 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fc28b-1b1a-4b21-97a0-ee42d5f72b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.960538 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fc28b-1b1a-4b21-97a0-ee42d5f72b37 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.050107 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1286/2606] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:01 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:02.054558 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec41dd-7fa2-4517-8684-9d43e3891027 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.085273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1321/2607] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:01 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:02.089719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fc28b-1b1a-4b21-97a0-ee42d5f72b37 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.122839 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec41dd-7fa2-4517-8684-9d43e3891027 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.157844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fc28b-1b1a-4b21-97a0-ee42d5f72b37 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.164737 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8038c9d-0a63-4d07-9be4-047a176a12f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.165360 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8038c9d-0a63-4d07-9be4-047a176a12f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.165823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8038c9d-0a63-4d07-9be4-047a176a12f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.166025 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8038c9d-0a63-4d07-9be4-047a176a12f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.171257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8038c9d-0a63-4d07-9be4-047a176a12f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.171257 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8038c9d-0a63-4d07-9be4-047a176a12f5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.187592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c395091-13a6-45aa-b318-32f70d1f7618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.188208 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c395091-13a6-45aa-b318-32f70d1f7618 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.188488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c395091-13a6-45aa-b318-32f70d1f7618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.188763 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c395091-13a6-45aa-b318-32f70d1f7618 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.189386 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c395091-13a6-45aa-b318-32f70d1f7618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.191318 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c395091-13a6-45aa-b318-32f70d1f7618 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.260602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1322/2608] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:02 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:02.264784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8038c9d-0a63-4d07-9be4-047a176a12f5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.274284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8038c9d-0a63-4d07-9be4-047a176a12f5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.280106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13693b2-93c5-452c-8887-1a309d579e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.280758 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13693b2-93c5-452c-8887-1a309d579e26 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.282386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13693b2-93c5-452c-8887-1a309d579e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.282386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13693b2-93c5-452c-8887-1a309d579e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.282386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13693b2-93c5-452c-8887-1a309d579e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.283824 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1287/2609] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:02 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:02.288221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13693b2-93c5-452c-8887-1a309d579e26 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.288796 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c395091-13a6-45aa-b318-32f70d1f7618 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.299379 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1323/2610] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:02.303187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13693b2-93c5-452c-8887-1a309d579e26 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.315415 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13693b2-93c5-452c-8887-1a309d579e26 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.316724 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c395091-13a6-45aa-b318-32f70d1f7618 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.325170 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ac720-ce51-4796-9c66-e048d21f1c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.325441 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ac720-ce51-4796-9c66-e048d21f1c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.325716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ac720-ce51-4796-9c66-e048d21f1c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.325991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ac720-ce51-4796-9c66-e048d21f1c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.326880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ac720-ce51-4796-9c66-e048d21f1c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.328870 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ac720-ce51-4796-9c66-e048d21f1c63 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.332274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d9eab-17c1-423a-b1af-f7e851e92465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.332905 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d9eab-17c1-423a-b1af-f7e851e92465 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.333195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d9eab-17c1-423a-b1af-f7e851e92465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.335555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d9eab-17c1-423a-b1af-f7e851e92465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.336293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d9eab-17c1-423a-b1af-f7e851e92465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.337977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d9eab-17c1-423a-b1af-f7e851e92465 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.353225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1288/2611] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:02.359081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ac720-ce51-4796-9c66-e048d21f1c63 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.375948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1324/2612] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:02.376525 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ac720-ce51-4796-9c66-e048d21f1c63 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.377355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d9eab-17c1-423a-b1af-f7e851e92465 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.389141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d9eab-17c1-423a-b1af-f7e851e92465 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.395677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ca814-ce7d-4c17-83f7-4d61769b9bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.396737 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ca814-ce7d-4c17-83f7-4d61769b9bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.397155 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ca814-ce7d-4c17-83f7-4d61769b9bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.397520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ca814-ce7d-4c17-83f7-4d61769b9bb0 admin admin] PATH_INFO: `/v3/projects/a532a86ae0674f26b2795a53c55b53ee/users/098e78dc604b4f5ab1e92a21baa4f3fc/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.403759 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848368f-657a-43b4-851d-9c3554fbfdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.404381 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848368f-657a-43b4-851d-9c3554fbfdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.404664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848368f-657a-43b4-851d-9c3554fbfdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.404938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848368f-657a-43b4-851d-9c3554fbfdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.408839 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848368f-657a-43b4-851d-9c3554fbfdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.410773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848368f-657a-43b4-851d-9c3554fbfdf1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.421811 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ca814-ce7d-4c17-83f7-4d61769b9bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a532a86ae0674f26b2795a53c55b53ee, user_id=098e78dc604b4f5ab1e92a21baa4f3fc, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.424853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ca814-ce7d-4c17-83f7-4d61769b9bb0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.427786 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1289/2613] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:02.432447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848368f-657a-43b4-851d-9c3554fbfdf1 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.444140 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848368f-657a-43b4-851d-9c3554fbfdf1 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.449657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf25a9-e0f1-4ab3-ac93-5d86b0c32d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.450364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf25a9-e0f1-4ab3-ac93-5d86b0c32d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.450678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf25a9-e0f1-4ab3-ac93-5d86b0c32d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.450959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf25a9-e0f1-4ab3-ac93-5d86b0c32d1c admin admin] PATH_INFO: `/v3/projects/5efa4ad691fe45fc834f52622b107f91/users/a36e36e5be6a454bbd087310af424ee3/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.467526 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf25a9-e0f1-4ab3-ac93-5d86b0c32d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efa4ad691fe45fc834f52622b107f91, user_id=a36e36e5be6a454bbd087310af424ee3, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.470415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf25a9-e0f1-4ab3-ac93-5d86b0c32d1c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.512722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1325/2614] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:02 2022] PUT /identity/v3/projects/a532a86ae0674f26b2795a53c55b53ee/users/098e78dc604b4f5ab1e92a21baa4f3fc/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:02.517944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e18cf-d8fa-4077-9196-1c76f496ca83 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.518274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e18cf-d8fa-4077-9196-1c76f496ca83 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.518540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e18cf-d8fa-4077-9196-1c76f496ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.538324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-484e18cf-d8fa-4077-9196-1c76f496ca83 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:02.539598 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-484e18cf-d8fa-4077-9196-1c76f496ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:02.603476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1326/2615] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:02.610787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e18cf-d8fa-4077-9196-1c76f496ca83 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.612362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-484e18cf-d8fa-4077-9196-1c76f496ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:02.655427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1290/2616] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:02 2022] PUT /identity/v3/projects/5efa4ad691fe45fc834f52622b107f91/users/a36e36e5be6a454bbd087310af424ee3/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:02.666039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312573-45a6-422d-a88b-791364885574 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.667012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312573-45a6-422d-a88b-791364885574 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.667422 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312573-45a6-422d-a88b-791364885574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.692613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e18cf-d8fa-4077-9196-1c76f496ca83 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.709930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-0c312573-45a6-422d-a88b-791364885574 None None] MFA Rules not processed for user `a36e36e5be6a454bbd087310af424ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:02.711405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0c312573-45a6-422d-a88b-791364885574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:02.766346 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:02.770519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc7cb-3abf-42b5-9278-de2b4aba0696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.774972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc7cb-3abf-42b5-9278-de2b4aba0696 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.775448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc7cb-3abf-42b5-9278-de2b4aba0696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.776613 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc7cb-3abf-42b5-9278-de2b4aba0696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.804656 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1291/2617] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:02.818394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c312573-45a6-422d-a88b-791364885574 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.820576 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0c312573-45a6-422d-a88b-791364885574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:02.871887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbc7cb-3abf-42b5-9278-de2b4aba0696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.874185 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbc7cb-3abf-42b5-9278-de2b4aba0696 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.887033 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1327/2618] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:54:02.910271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c312573-45a6-422d-a88b-791364885574 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.922443 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4cb15-0aef-45ac-b845-7cfd0a25814f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.924031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4cb15-0aef-45ac-b845-7cfd0a25814f service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.924413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4cb15-0aef-45ac-b845-7cfd0a25814f service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.926880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4cb15-0aef-45ac-b845-7cfd0a25814f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.944330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4cb15-0aef-45ac-b845-7cfd0a25814f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.946060 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4cb15-0aef-45ac-b845-7cfd0a25814f service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.956119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1292/2619] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:02.958038 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:03.415437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:07.648006 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc7cb-3abf-42b5-9278-de2b4aba0696 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:07.659239 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc7cb-3abf-42b5-9278-de2b4aba0696 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:07.663895 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:07.667105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:07.667105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:07.667105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] PATH_INFO: `/v3/users/a36e36e5be6a454bbd087310af424ee3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:07.667105 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36e36e5be6a454bbd087310af424ee3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:07.668882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:07.878315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36e36e5be6a454bbd087310af424ee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.878998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36e36e5be6a454bbd087310af424ee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.888631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36e36e5be6a454bbd087310af424ee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.912667 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36e36e5be6a454bbd087310af424ee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:08.038296 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36e36e5be6a454bbd087310af424ee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:08.050558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1328/2620] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:07 2022] DELETE /identity/v3/users/a36e36e5be6a454bbd087310af424ee3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:08.055251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f024444-9c41-4f84-a2fe-5a46a9fc322e None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.055251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f024444-9c41-4f84-a2fe-5a46a9fc322e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.055251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f024444-9c41-4f84-a2fe-5a46a9fc322e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.082221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-3f024444-9c41-4f84-a2fe-5a46a9fc322e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:08.084345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3f024444-9c41-4f84-a2fe-5a46a9fc322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:08.234844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1293/2621] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:08.242237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:08.243635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:08.324128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94671068-6e92-4bb5-8fbe-b6c727dc847a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:08.328237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6478e3-4595-4c1c-911b-c976b2b25c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:08.329137 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6478e3-4595-4c1c-911b-c976b2b25c43 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.329695 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6478e3-4595-4c1c-911b-c976b2b25c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.330282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6478e3-4595-4c1c-911b-c976b2b25c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.341833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6478e3-4595-4c1c-911b-c976b2b25c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:08.343640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6478e3-4595-4c1c-911b-c976b2b25c43 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:08.367429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1329/2622] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:08.641516 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f024444-9c41-4f84-a2fe-5a46a9fc322e None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:08.668328 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f024444-9c41-4f84-a2fe-5a46a9fc322e None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:08.683492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5532ee1-cf78-4c6e-b4ba-c55b95d2dfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:08.684136 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532ee1-cf78-4c6e-b4ba-c55b95d2dfad service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.684423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532ee1-cf78-4c6e-b4ba-c55b95d2dfad service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.684701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532ee1-cf78-4c6e-b4ba-c55b95d2dfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.686671 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e5532ee1-cf78-4c6e-b4ba-c55b95d2dfad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:08.709729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5532ee1-cf78-4c6e-b4ba-c55b95d2dfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:08.717233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5532ee1-cf78-4c6e-b4ba-c55b95d2dfad service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:08.734878 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1294/2623] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:08.896200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261992-7f18-4f14-86ea-39abd03f940f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.896673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261992-7f18-4f14-86ea-39abd03f940f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.896839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261992-7f18-4f14-86ea-39abd03f940f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.957089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a8261992-7f18-4f14-86ea-39abd03f940f None None] MFA Rules not processed for user `098e78dc604b4f5ab1e92a21baa4f3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:08.959258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a8261992-7f18-4f14-86ea-39abd03f940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:09.057045 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:09.064442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5532ee1-cf78-4c6e-b4ba-c55b95d2dfad service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.069871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e5532ee1-cf78-4c6e-b4ba-c55b95d2dfad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:09.093931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5532ee1-cf78-4c6e-b4ba-c55b95d2dfad service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.096108 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1330/2624] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:09.106708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8261992-7f18-4f14-86ea-39abd03f940f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.109520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a8261992-7f18-4f14-86ea-39abd03f940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:09.115623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.116542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.117156 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.117769 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] PATH_INFO: `/v3/projects/5efa4ad691fe45fc834f52622b107f91` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.120005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efa4ad691fe45fc834f52622b107f91)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.123157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.145294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:09.162232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8261992-7f18-4f14-86ea-39abd03f940f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.167951 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bbcc5-3792-4e26-8a02-93eaebbcea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.168586 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bbcc5-3792-4e26-8a02-93eaebbcea5a admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.168897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bbcc5-3792-4e26-8a02-93eaebbcea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.169124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bbcc5-3792-4e26-8a02-93eaebbcea5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.172513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bbcc5-3792-4e26-8a02-93eaebbcea5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.172513 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bbcc5-3792-4e26-8a02-93eaebbcea5a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.299716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efa4ad691fe45fc834f52622b107f91', 'request_id': 'req-b7f546da-7238-421c-8186-5068e7d84e84'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:09.356608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1331/2625] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:09 2022] POST /identity/v3/projects => generated 383 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:09.360661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bbcc5-3792-4e26-8a02-93eaebbcea5a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.430664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efa4ad691fe45fc834f52622b107f91', 'request_id': 'req-b7f546da-7238-421c-8186-5068e7d84e84'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:09.439632 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efa4ad691fe45fc834f52622b107f91', 'request_id': 'req-b7f546da-7238-421c-8186-5068e7d84e84'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:09.455909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bbcc5-3792-4e26-8a02-93eaebbcea5a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.457960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] The token cache is being invalidate because project 5efa4ad691fe45fc834f52622b107f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:09.458314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:09.458974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-b7f546da-7238-421c-8186-5068e7d84e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:09.460667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1295/2626] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:09 2022] DELETE /identity/v3/projects/5efa4ad691fe45fc834f52622b107f91 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:09.464927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b18f5-cca5-44ef-a414-ca394480b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.465442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d280e-1b56-43e3-a608-1dfe4ba6f337 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.465906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b18f5-cca5-44ef-a414-ca394480b4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.466122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d280e-1b56-43e3-a608-1dfe4ba6f337 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.466277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b18f5-cca5-44ef-a414-ca394480b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.466428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d280e-1b56-43e3-a608-1dfe4ba6f337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.466547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b18f5-cca5-44ef-a414-ca394480b4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.467132 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b18f5-cca5-44ef-a414-ca394480b4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.469205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b18f5-cca5-44ef-a414-ca394480b4a7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.497702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e93d280e-1b56-43e3-a608-1dfe4ba6f337 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:09.499488 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e93d280e-1b56-43e3-a608-1dfe4ba6f337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:09.509281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1296/2627] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:09.518694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530daa35-f0c6-4629-b95d-5eeb6ae65df7 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.519134 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530daa35-f0c6-4629-b95d-5eeb6ae65df7 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.524749 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530daa35-f0c6-4629-b95d-5eeb6ae65df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.542896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-530daa35-f0c6-4629-b95d-5eeb6ae65df7 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:09.544289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-530daa35-f0c6-4629-b95d-5eeb6ae65df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:09.563352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1297/2628] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:09.567539 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530daa35-f0c6-4629-b95d-5eeb6ae65df7 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.577722 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530daa35-f0c6-4629-b95d-5eeb6ae65df7 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.590748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1332/2629] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:09 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:09.593929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bd527-c596-4b81-9ad7-ae95667467e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.593929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd527-c596-4b81-9ad7-ae95667467e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.593929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd527-c596-4b81-9ad7-ae95667467e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.593929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd527-c596-4b81-9ad7-ae95667467e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.594289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bd527-c596-4b81-9ad7-ae95667467e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:09.594289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bd527-c596-4b81-9ad7-ae95667467e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.596303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bd527-c596-4b81-9ad7-ae95667467e0 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.597193 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b18f5-cca5-44ef-a414-ca394480b4a7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.600857 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d46b18f5-cca5-44ef-a414-ca394480b4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:09.622501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1298/2630] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:09.623570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bd527-c596-4b81-9ad7-ae95667467e0 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.625326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b18f5-cca5-44ef-a414-ca394480b4a7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.631792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d55375-3d81-4af4-b4a2-455ea562b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.632423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d55375-3d81-4af4-b4a2-455ea562b11d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.632705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d55375-3d81-4af4-b4a2-455ea562b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.632979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d55375-3d81-4af4-b4a2-455ea562b11d admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.633665 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d55375-3d81-4af4-b4a2-455ea562b11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.635918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bd527-c596-4b81-9ad7-ae95667467e0 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.636307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d55375-3d81-4af4-b4a2-455ea562b11d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.642970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bbd97-b72f-4ef1-b2e6-4ccfaa897373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.643540 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bbd97-b72f-4ef1-b2e6-4ccfaa897373 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.643853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bbd97-b72f-4ef1-b2e6-4ccfaa897373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.644135 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bbd97-b72f-4ef1-b2e6-4ccfaa897373 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.644825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bbd97-b72f-4ef1-b2e6-4ccfaa897373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.646785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bbd97-b72f-4ef1-b2e6-4ccfaa897373 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.654696 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1333/2631] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:09.655693 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d55375-3d81-4af4-b4a2-455ea562b11d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.671241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d55375-3d81-4af4-b4a2-455ea562b11d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.678704 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4486f9-1027-460e-90ab-37709e84cc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.682714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4486f9-1027-460e-90ab-37709e84cc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.682714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4486f9-1027-460e-90ab-37709e84cc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.682714 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4486f9-1027-460e-90ab-37709e84cc6e admin admin] PATH_INFO: `/v3/projects/a34c4a92b7e840d7b80d34cd56815666/users/a829d76ee1f94e9abd0fb3cebf7280fc/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.703889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4486f9-1027-460e-90ab-37709e84cc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34c4a92b7e840d7b80d34cd56815666, user_id=a829d76ee1f94e9abd0fb3cebf7280fc, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.706361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4486f9-1027-460e-90ab-37709e84cc6e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.742766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1299/2632] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:09 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:09.747825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bbd97-b72f-4ef1-b2e6-4ccfaa897373 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.778016 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1334/2633] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:09 2022] PUT /identity/v3/projects/a34c4a92b7e840d7b80d34cd56815666/users/a829d76ee1f94e9abd0fb3cebf7280fc/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:09.781551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4486f9-1027-460e-90ab-37709e84cc6e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.817841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bbd97-b72f-4ef1-b2e6-4ccfaa897373 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.851200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4486f9-1027-460e-90ab-37709e84cc6e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.858608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dc336-2076-4eaa-bbb7-efafabffeaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.859407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc336-2076-4eaa-bbb7-efafabffeaee admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.859761 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc336-2076-4eaa-bbb7-efafabffeaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.860100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc336-2076-4eaa-bbb7-efafabffeaee admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.860828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dc336-2076-4eaa-bbb7-efafabffeaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.862514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dc336-2076-4eaa-bbb7-efafabffeaee admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.874013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1335/2634] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:09.878127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dc336-2076-4eaa-bbb7-efafabffeaee admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.882388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:09.888603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1e4e0-eabe-466e-bfa5-7cdc8975d79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.888828 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dc336-2076-4eaa-bbb7-efafabffeaee admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.889387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1e4e0-eabe-466e-bfa5-7cdc8975d79a admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.889736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1e4e0-eabe-466e-bfa5-7cdc8975d79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.890077 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1e4e0-eabe-466e-bfa5-7cdc8975d79a admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.890971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1e4e0-eabe-466e-bfa5-7cdc8975d79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.892943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1e4e0-eabe-466e-bfa5-7cdc8975d79a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.894381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3249a-500d-44c2-b0d1-8eed5eadd849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.895362 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3249a-500d-44c2-b0d1-8eed5eadd849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.895879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3249a-500d-44c2-b0d1-8eed5eadd849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.896337 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3249a-500d-44c2-b0d1-8eed5eadd849 admin admin] PATH_INFO: `/v3/projects/a34c4a92b7e840d7b80d34cd56815666/users/a829d76ee1f94e9abd0fb3cebf7280fc/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.899109 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3249a-500d-44c2-b0d1-8eed5eadd849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34c4a92b7e840d7b80d34cd56815666, user_id=a829d76ee1f94e9abd0fb3cebf7280fc, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.902039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3249a-500d-44c2-b0d1-8eed5eadd849 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.914310 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1336/2635] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:09 2022] PUT /identity/v3/projects/a34c4a92b7e840d7b80d34cd56815666/users/a829d76ee1f94e9abd0fb3cebf7280fc/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:09.990623 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1300/2636] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:09 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:09.995893 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3249a-500d-44c2-b0d1-8eed5eadd849 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:10.011769 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:10.076561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3249a-500d-44c2-b0d1-8eed5eadd849 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:10.081561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dce37-b707-4142-866d-068760f92f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:10.082232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dce37-b707-4142-866d-068760f92f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:10.082514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dce37-b707-4142-866d-068760f92f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:10.083133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dce37-b707-4142-866d-068760f92f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:10.083804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dce37-b707-4142-866d-068760f92f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:10.085465 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dce37-b707-4142-866d-068760f92f4f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:10.097546 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1337/2637] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:10.101355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1e4e0-eabe-466e-bfa5-7cdc8975d79a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:10.113054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1e4e0-eabe-466e-bfa5-7cdc8975d79a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:10.124083 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708910a-d9b2-4478-9034-2a47036848e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:10.124733 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708910a-d9b2-4478-9034-2a47036848e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:10.125020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708910a-d9b2-4478-9034-2a47036848e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:10.125391 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708910a-d9b2-4478-9034-2a47036848e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:10.126429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708910a-d9b2-4478-9034-2a47036848e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:10.128419 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708910a-d9b2-4478-9034-2a47036848e7 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:10.156001 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1301/2638] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:10.156217 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dce37-b707-4142-866d-068760f92f4f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:10.168882 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dce37-b707-4142-866d-068760f92f4f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:10.178056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847731c-5a75-4a2b-95f8-634b4be179ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:10.178930 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847731c-5a75-4a2b-95f8-634b4be179ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:10.179279 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847731c-5a75-4a2b-95f8-634b4be179ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:10.179627 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847731c-5a75-4a2b-95f8-634b4be179ff admin admin] PATH_INFO: `/v3/projects/e27eb550e8344233af0ec1fd741d9852/users/c1567c2e8dd3472690387fae64d3ae54/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:10.212363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847731c-5a75-4a2b-95f8-634b4be179ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27eb550e8344233af0ec1fd741d9852, user_id=c1567c2e8dd3472690387fae64d3ae54, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:10.215148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847731c-5a75-4a2b-95f8-634b4be179ff admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:10.318413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1338/2639] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:10 2022] PUT /identity/v3/projects/e27eb550e8344233af0ec1fd741d9852/users/c1567c2e8dd3472690387fae64d3ae54/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:10.324584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e16ac-9009-4081-85b8-b3e8df761f9a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:10.324871 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e16ac-9009-4081-85b8-b3e8df761f9a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:10.325149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e16ac-9009-4081-85b8-b3e8df761f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:10.347212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c85e16ac-9009-4081-85b8-b3e8df761f9a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:10.348743 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c85e16ac-9009-4081-85b8-b3e8df761f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:10.427230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1302/2640] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:10.437990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847731c-5a75-4a2b-95f8-634b4be179ff admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:10.439762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8847731c-5a75-4a2b-95f8-634b4be179ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:10.508365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847731c-5a75-4a2b-95f8-634b4be179ff admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:10.512418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430f6f1-6d2f-4904-ac11-3066a3f87f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:10.513048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430f6f1-6d2f-4904-ac11-3066a3f87f6a service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:10.513355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430f6f1-6d2f-4904-ac11-3066a3f87f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:10.513655 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430f6f1-6d2f-4904-ac11-3066a3f87f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:10.530941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430f6f1-6d2f-4904-ac11-3066a3f87f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:10.532460 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430f6f1-6d2f-4904-ac11-3066a3f87f6a service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:10.544190 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1339/2641] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:12.554563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1595a8-49ff-4f83-86b8-9ca4da4c74ca None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:12.555555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1595a8-49ff-4f83-86b8-9ca4da4c74ca None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:12.556000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1595a8-49ff-4f83-86b8-9ca4da4c74ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:12.628639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5b1595a8-49ff-4f83-86b8-9ca4da4c74ca None None] MFA Rules not processed for user `c1567c2e8dd3472690387fae64d3ae54`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:12.628639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5b1595a8-49ff-4f83-86b8-9ca4da4c74ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:12.742264 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1303/2642] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:12.758636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430f6f1-6d2f-4904-ac11-3066a3f87f6a service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:12.760716 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d430f6f1-6d2f-4904-ac11-3066a3f87f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:12.866889 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430f6f1-6d2f-4904-ac11-3066a3f87f6a service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:12.871568 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543d5ec-b115-4bed-8498-9220df02bfae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:12.872195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543d5ec-b115-4bed-8498-9220df02bfae service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:12.872497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543d5ec-b115-4bed-8498-9220df02bfae service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:12.872833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543d5ec-b115-4bed-8498-9220df02bfae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:12.888313 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543d5ec-b115-4bed-8498-9220df02bfae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:12.891280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543d5ec-b115-4bed-8498-9220df02bfae service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:12.901978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1340/2643] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:15.094992 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ba45f-9c52-4b4c-b981-e1a6118eea95 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:15.095945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ba45f-9c52-4b4c-b981-e1a6118eea95 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:15.096560 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ba45f-9c52-4b4c-b981-e1a6118eea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:15.126139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ea0ba45f-9c52-4b4c-b981-e1a6118eea95 None None] MFA Rules not processed for user `c1567c2e8dd3472690387fae64d3ae54`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:15.128744 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ea0ba45f-9c52-4b4c-b981-e1a6118eea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:15.145000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1304/2644] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:15.178012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543d5ec-b115-4bed-8498-9220df02bfae service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:15.179772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7543d5ec-b115-4bed-8498-9220df02bfae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:15.212136 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543d5ec-b115-4bed-8498-9220df02bfae service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:15.219024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:15.219824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:15.220104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:15.220635 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] PATH_INFO: `/v3/users/6e5963aeb4514b80a3d786da8a05da0c` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:15.222103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5963aeb4514b80a3d786da8a05da0c)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:15.224329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:15.381675 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:15.459614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ba45f-9c52-4b4c-b981-e1a6118eea95 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:15.462608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ea0ba45f-9c52-4b4c-b981-e1a6118eea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:15.478396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ba45f-9c52-4b4c-b981-e1a6118eea95 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:15.483932 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a046f6-ce09-4883-80d6-db7ccdbcee69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:15.484872 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a046f6-ce09-4883-80d6-db7ccdbcee69 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:15.485214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a046f6-ce09-4883-80d6-db7ccdbcee69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:15.485689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a046f6-ce09-4883-80d6-db7ccdbcee69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:15.488001 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-44a046f6-ce09-4883-80d6-db7ccdbcee69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:15.505979 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a046f6-ce09-4883-80d6-db7ccdbcee69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:15.508353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a046f6-ce09-4883-80d6-db7ccdbcee69 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:15.509368 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5963aeb4514b80a3d786da8a05da0c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:15.510822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5963aeb4514b80a3d786da8a05da0c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:15.522267 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1305/2645] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:54:15.524070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5963aeb4514b80a3d786da8a05da0c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:15.543280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5963aeb4514b80a3d786da8a05da0c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:15.643719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-db1cef01-02d9-48d5-8aac-b0f6b6f673aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5963aeb4514b80a3d786da8a05da0c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:15.648913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1341/2646] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:15 2022] DELETE /identity/v3/users/6e5963aeb4514b80a3d786da8a05da0c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:16.079006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a046f6-ce09-4883-80d6-db7ccdbcee69 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:16.101619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a046f6-ce09-4883-80d6-db7ccdbcee69 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:16.235969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:16.261020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:16.261689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.262527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.262816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] PATH_INFO: `/v3/projects/1587a1b0dd0d4284afdd6384fe725ef0` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.264586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1587a1b0dd0d4284afdd6384fe725ef0)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:16.266782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:16.439980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1587a1b0dd0d4284afdd6384fe725ef0', 'request_id': 'req-e701abd2-fcf0-45bb-9193-cc31ae1be18f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:16.576857 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1587a1b0dd0d4284afdd6384fe725ef0', 'request_id': 'req-e701abd2-fcf0-45bb-9193-cc31ae1be18f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:16.584345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1587a1b0dd0d4284afdd6384fe725ef0', 'request_id': 'req-e701abd2-fcf0-45bb-9193-cc31ae1be18f'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:16.598631 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] The token cache is being invalidate because project 1587a1b0dd0d4284afdd6384fe725ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:16.598964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:16.599621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e701abd2-fcf0-45bb-9193-cc31ae1be18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:16.601579 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1306/2647] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:16 2022] DELETE /identity/v3/projects/1587a1b0dd0d4284afdd6384fe725ef0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:16.607179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2f13-6c27-44cb-b630-a2fdb727c697 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.608208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2f13-6c27-44cb-b630-a2fdb727c697 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.613477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2f13-6c27-44cb-b630-a2fdb727c697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.628780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-476d2f13-6c27-44cb-b630-a2fdb727c697 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:16.629990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-476d2f13-6c27-44cb-b630-a2fdb727c697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:16.724871 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1342/2648] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:16.739471 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c75247-939f-47ee-a4ff-5398a8e9b440 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.739779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c75247-939f-47ee-a4ff-5398a8e9b440 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.740071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c75247-939f-47ee-a4ff-5398a8e9b440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.763392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-11c75247-939f-47ee-a4ff-5398a8e9b440 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:16.764704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-11c75247-939f-47ee-a4ff-5398a8e9b440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:16.774984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1307/2649] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:16.781153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d2f13-6c27-44cb-b630-a2fdb727c697 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:16.812237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d2f13-6c27-44cb-b630-a2fdb727c697 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:16.818316 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0d3c7-0d1f-4928-99aa-4a8a92e03486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:16.819084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0d3c7-0d1f-4928-99aa-4a8a92e03486 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.819450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0d3c7-0d1f-4928-99aa-4a8a92e03486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.819798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0d3c7-0d1f-4928-99aa-4a8a92e03486 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.820551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0d3c7-0d1f-4928-99aa-4a8a92e03486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:16.820918 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0d3c7-0d1f-4928-99aa-4a8a92e03486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:16.823510 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0d3c7-0d1f-4928-99aa-4a8a92e03486 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:16.841285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1343/2650] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:16.841980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c75247-939f-47ee-a4ff-5398a8e9b440 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:16.858087 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c75247-939f-47ee-a4ff-5398a8e9b440 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:16.865954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3a2e3-b295-4b57-af07-28e21945145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:16.866619 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3a2e3-b295-4b57-af07-28e21945145c admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.866978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3a2e3-b295-4b57-af07-28e21945145c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.867392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3a2e3-b295-4b57-af07-28e21945145c admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.868326 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3a2e3-b295-4b57-af07-28e21945145c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:16.871284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3a2e3-b295-4b57-af07-28e21945145c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.039838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1308/2651] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:16 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:17.044198 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0d3c7-0d1f-4928-99aa-4a8a92e03486 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.054485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0d3c7-0d1f-4928-99aa-4a8a92e03486 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.128868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fdf71-d8e4-4722-a98c-6b892f8e952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.129898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fdf71-d8e4-4722-a98c-6b892f8e952b admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.130422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fdf71-d8e4-4722-a98c-6b892f8e952b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.130906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fdf71-d8e4-4722-a98c-6b892f8e952b admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.131723 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fdf71-d8e4-4722-a98c-6b892f8e952b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.134123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fdf71-d8e4-4722-a98c-6b892f8e952b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.257764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1344/2652] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:17 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:17.262862 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3a2e3-b295-4b57-af07-28e21945145c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.278485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3a2e3-b295-4b57-af07-28e21945145c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.285999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413129bd-75f1-4408-bac8-3d5001c7af26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.286723 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413129bd-75f1-4408-bac8-3d5001c7af26 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.289287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413129bd-75f1-4408-bac8-3d5001c7af26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.289287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413129bd-75f1-4408-bac8-3d5001c7af26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.289287 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413129bd-75f1-4408-bac8-3d5001c7af26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.290602 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413129bd-75f1-4408-bac8-3d5001c7af26 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.308543 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fdf71-d8e4-4722-a98c-6b892f8e952b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.319761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1309/2653] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:17.325031 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fdf71-d8e4-4722-a98c-6b892f8e952b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.331012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041966d8-b21a-4fd1-a549-73806ab87ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.331901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041966d8-b21a-4fd1-a549-73806ab87ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.335898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041966d8-b21a-4fd1-a549-73806ab87ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.335898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041966d8-b21a-4fd1-a549-73806ab87ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.335898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041966d8-b21a-4fd1-a549-73806ab87ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.335898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041966d8-b21a-4fd1-a549-73806ab87ff3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.355403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1345/2654] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:17.356509 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413129bd-75f1-4408-bac8-3d5001c7af26 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.368569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413129bd-75f1-4408-bac8-3d5001c7af26 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.386618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51828731-aac0-4a18-a026-5e86717c7cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.387553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51828731-aac0-4a18-a026-5e86717c7cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.388030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51828731-aac0-4a18-a026-5e86717c7cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.389070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51828731-aac0-4a18-a026-5e86717c7cb4 admin admin] PATH_INFO: `/v3/projects/6c4d2e4a81f24d8e980bf2d7e845643b/users/7e201fc6021b4e788af5441a2ffb0777/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.410248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51828731-aac0-4a18-a026-5e86717c7cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d2e4a81f24d8e980bf2d7e845643b, user_id=7e201fc6021b4e788af5441a2ffb0777, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.413080 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51828731-aac0-4a18-a026-5e86717c7cb4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.485462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041966d8-b21a-4fd1-a549-73806ab87ff3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.488963 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-041966d8-b21a-4fd1-a549-73806ab87ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:17.520887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041966d8-b21a-4fd1-a549-73806ab87ff3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.526359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1310/2655] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:17 2022] PUT /identity/v3/projects/6c4d2e4a81f24d8e980bf2d7e845643b/users/7e201fc6021b4e788af5441a2ffb0777/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:17.531378 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40db71-969c-42b5-a23c-697c7c173577 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.531711 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40db71-969c-42b5-a23c-697c7c173577 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.531824 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:17.532041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40db71-969c-42b5-a23c-697c7c173577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.560912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-ce40db71-969c-42b5-a23c-697c7c173577 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:17.574055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ce40db71-969c-42b5-a23c-697c7c173577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:17.616275 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.617608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.618060 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.618518 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] PATH_INFO: `/v3/users/0ddb6e3841094efda7c3c332791d4d5a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.621357 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ddb6e3841094efda7c3c332791d4d5a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.624552 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.661657 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1311/2656] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:17.674690 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40db71-969c-42b5-a23c-697c7c173577 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.676154 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-ce40db71-969c-42b5-a23c-697c7c173577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:17.744162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40db71-969c-42b5-a23c-697c7c173577 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.748880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be852c-fcb3-4cf5-b594-5b64751163f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.749592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be852c-fcb3-4cf5-b594-5b64751163f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.749816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be852c-fcb3-4cf5-b594-5b64751163f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.750051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be852c-fcb3-4cf5-b594-5b64751163f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.761428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be852c-fcb3-4cf5-b594-5b64751163f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.761903 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be852c-fcb3-4cf5-b594-5b64751163f8 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.778036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1312/2657] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:54:17.904798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ddb6e3841094efda7c3c332791d4d5a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:17.905553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ddb6e3841094efda7c3c332791d4d5a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:17.914007 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ddb6e3841094efda7c3c332791d4d5a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:17.948602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ddb6e3841094efda7c3c332791d4d5a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:17.987731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:18.072075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ddb6e3841094efda7c3c332791d4d5a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:18.079027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1346/2658] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:17 2022] DELETE /identity/v3/users/0ddb6e3841094efda7c3c332791d4d5a => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:18.083742 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d505d8-1b01-4946-a402-46fb9733dc59 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:18.084139 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d505d8-1b01-4946-a402-46fb9733dc59 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:18.084356 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d505d8-1b01-4946-a402-46fb9733dc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:18.108027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-80d505d8-1b01-4946-a402-46fb9733dc59 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:18.114945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-80d505d8-1b01-4946-a402-46fb9733dc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:18.192499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1313/2659] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:18.208015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:18.209612 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:18.307968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ee3ce-0633-41d4-9e2b-0777354bc871 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:18.311931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24a1f3-99ef-4b72-8b08-8b6c62ddf2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:18.312793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24a1f3-99ef-4b72-8b08-8b6c62ddf2cc service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:18.313336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24a1f3-99ef-4b72-8b08-8b6c62ddf2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:18.313806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24a1f3-99ef-4b72-8b08-8b6c62ddf2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:18.325800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24a1f3-99ef-4b72-8b08-8b6c62ddf2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:18.327809 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24a1f3-99ef-4b72-8b08-8b6c62ddf2cc service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:18.343236 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1347/2660] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:18.676195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86528d-bf4b-4d32-8ce6-ebefc6aa0366 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:18.676677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86528d-bf4b-4d32-8ce6-ebefc6aa0366 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:18.676782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86528d-bf4b-4d32-8ce6-ebefc6aa0366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:18.715515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1f86528d-bf4b-4d32-8ce6-ebefc6aa0366 None None] MFA Rules not processed for user `a829d76ee1f94e9abd0fb3cebf7280fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:18.717658 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1f86528d-bf4b-4d32-8ce6-ebefc6aa0366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:18.803523 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1314/2661] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:18.817867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24a1f3-99ef-4b72-8b08-8b6c62ddf2cc service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:18.819372 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7c24a1f3-99ef-4b72-8b08-8b6c62ddf2cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:18.886559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24a1f3-99ef-4b72-8b08-8b6c62ddf2cc service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:18.890802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b389ed7-b9a8-478d-86e6-54ebc3dda45c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e56c9d900f4e4e91ea944d4cb0a40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:18.891508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b389ed7-b9a8-478d-86e6-54ebc3dda45c service glance] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:18.892756 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b389ed7-b9a8-478d-86e6-54ebc3dda45c service glance] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:18.893104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b389ed7-b9a8-478d-86e6-54ebc3dda45c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:18.895035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7b389ed7-b9a8-478d-86e6-54ebc3dda45c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:18.956288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b389ed7-b9a8-478d-86e6-54ebc3dda45c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:18.957776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b389ed7-b9a8-478d-86e6-54ebc3dda45c service glance] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:18.967479 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1348/2662] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:18.973004 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86528d-bf4b-4d32-8ce6-ebefc6aa0366 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:18.974549 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1f86528d-bf4b-4d32-8ce6-ebefc6aa0366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:18.991835 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86528d-bf4b-4d32-8ce6-ebefc6aa0366 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:19.000137 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:19.000912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:19.001199 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:19.001641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] PATH_INFO: `/v3/projects/908559ec7b9f4752aebc671361f08374` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:19.002819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908559ec7b9f4752aebc671361f08374)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:19.004729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:19.151955 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908559ec7b9f4752aebc671361f08374', 'request_id': 'req-246e1248-691c-404f-a86f-356cb1e835d9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:19.282141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908559ec7b9f4752aebc671361f08374', 'request_id': 'req-246e1248-691c-404f-a86f-356cb1e835d9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:19.293061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908559ec7b9f4752aebc671361f08374', 'request_id': 'req-246e1248-691c-404f-a86f-356cb1e835d9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:19.308858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] The token cache is being invalidate because project 908559ec7b9f4752aebc671361f08374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:19.309208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd394a-dfaa-4685-ac70-b232862805e3 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:19.309327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:19.309532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd394a-dfaa-4685-ac70-b232862805e3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:19.309903 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd394a-dfaa-4685-ac70-b232862805e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:19.310019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:19.314977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1315/2663] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:18 2022] DELETE /identity/v3/projects/908559ec7b9f4752aebc671361f08374 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:19.320908 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:19.328212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:19.344221 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-06fd394a-dfaa-4685-ac70-b232862805e3 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:19.345582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-06fd394a-dfaa-4685-ac70-b232862805e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:19.418841 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1248-691c-404f-a86f-356cb1e835d9 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:19.419993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1349/2664] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:19.424109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:19.424917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:19.425270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:19.425615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] PATH_INFO: `/v3/users/4eec91b5cda84d88bc4633f2b5e4c984` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:19.426958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eec91b5cda84d88bc4633f2b5e4c984)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:19.429282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:19.443779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd394a-dfaa-4685-ac70-b232862805e3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:19.445068 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-06fd394a-dfaa-4685-ac70-b232862805e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:19.530618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd394a-dfaa-4685-ac70-b232862805e3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:19.537209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50c990-87f6-4b2e-b5d8-1c39d022754c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:19.537859 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50c990-87f6-4b2e-b5d8-1c39d022754c service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:19.538138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50c990-87f6-4b2e-b5d8-1c39d022754c service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:19.538483 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50c990-87f6-4b2e-b5d8-1c39d022754c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:19.549297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50c990-87f6-4b2e-b5d8-1c39d022754c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:19.551336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50c990-87f6-4b2e-b5d8-1c39d022754c service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:19.560898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1350/2665] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:54:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:54:19.637082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427f70c-eaa1-4316-b0de-edc05035ccef None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:19.637832 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427f70c-eaa1-4316-b0de-edc05035ccef None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:19.638049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427f70c-eaa1-4316-b0de-edc05035ccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:19.671880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1427f70c-eaa1-4316-b0de-edc05035ccef None None] MFA Rules not processed for user `7e201fc6021b4e788af5441a2ffb0777`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:19.673216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1427f70c-eaa1-4316-b0de-edc05035ccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:19.770546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eec91b5cda84d88bc4633f2b5e4c984'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:19.801886 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1351/2666] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:19.812369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427f70c-eaa1-4316-b0de-edc05035ccef None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:19.815249 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1427f70c-eaa1-4316-b0de-edc05035ccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:19.817930 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eec91b5cda84d88bc4633f2b5e4c984'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:19.860547 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427f70c-eaa1-4316-b0de-edc05035ccef None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:19.870403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055729c6-d460-448e-94fa-7540bc3ed8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:19.871235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055729c6-d460-448e-94fa-7540bc3ed8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:19.871595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055729c6-d460-448e-94fa-7540bc3ed8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:19.871949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055729c6-d460-448e-94fa-7540bc3ed8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:19.873070 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055729c6-d460-448e-94fa-7540bc3ed8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:19.875262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055729c6-d460-448e-94fa-7540bc3ed8e3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:19.945863 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eec91b5cda84d88bc4633f2b5e4c984'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:19.955129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eec91b5cda84d88bc4633f2b5e4c984'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:19.957590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eec91b5cda84d88bc4633f2b5e4c984'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:19.976545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1316/2667] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:19 2022] DELETE /identity/v3/users/4eec91b5cda84d88bc4633f2b5e4c984 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:20.011218 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:20.021631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1352/2668] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:19 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:20.026803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:20.028719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:20.198834 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800bc1c-4d65-498b-a57b-05b594d6ce45 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:20.360019 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b96af-c2e8-4ad0-99c7-174dee0430ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:20.361399 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b96af-c2e8-4ad0-99c7-174dee0430ec admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:20.361399 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b96af-c2e8-4ad0-99c7-174dee0430ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:20.362129 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b96af-c2e8-4ad0-99c7-174dee0430ec admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:20.365702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b96af-c2e8-4ad0-99c7-174dee0430ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:20.368413 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b96af-c2e8-4ad0-99c7-174dee0430ec admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:20.518016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1317/2669] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:20 2022] POST /identity/v3/users => generated 293 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:20.519266 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055729c6-d460-448e-94fa-7540bc3ed8e3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:20.533894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055729c6-d460-448e-94fa-7540bc3ed8e3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:20.540924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a1c58-4788-408e-a77a-fb28edb5cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:20.542691 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a1c58-4788-408e-a77a-fb28edb5cd1a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:20.543181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a1c58-4788-408e-a77a-fb28edb5cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:20.543700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a1c58-4788-408e-a77a-fb28edb5cd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:20.544632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a1c58-4788-408e-a77a-fb28edb5cd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:20.546553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a1c58-4788-408e-a77a-fb28edb5cd1a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:20.563778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1353/2670] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:20.568253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b96af-c2e8-4ad0-99c7-174dee0430ec admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:20.580447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b96af-c2e8-4ad0-99c7-174dee0430ec admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:20.586956 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb41f1-6b1e-4a50-802b-348afdc4071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:20.588041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb41f1-6b1e-4a50-802b-348afdc4071d admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:20.588816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb41f1-6b1e-4a50-802b-348afdc4071d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:20.589121 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb41f1-6b1e-4a50-802b-348afdc4071d admin admin] PATH_INFO: `/v3/projects/8032e0380e6143f785074f693ea2e22f/users/173de8c4b5a04eb5906d9fc7360e16d6/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:20.609770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb41f1-6b1e-4a50-802b-348afdc4071d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8032e0380e6143f785074f693ea2e22f, user_id=173de8c4b5a04eb5906d9fc7360e16d6, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:20.612515 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb41f1-6b1e-4a50-802b-348afdc4071d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:20.735530 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:20.759938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1318/2671] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:20 2022] PUT /identity/v3/projects/8032e0380e6143f785074f693ea2e22f/users/173de8c4b5a04eb5906d9fc7360e16d6/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:20.763902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a1c58-4788-408e-a77a-fb28edb5cd1a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:20.784319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a1c58-4788-408e-a77a-fb28edb5cd1a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:20.825221 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb41f1-6b1e-4a50-802b-348afdc4071d admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:20.829330 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bcbb41f1-6b1e-4a50-802b-348afdc4071d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:20.925960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a62f0-da88-4400-b306-dd34aa8c0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:20.926656 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a62f0-da88-4400-b306-dd34aa8c0e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:20.927829 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a62f0-da88-4400-b306-dd34aa8c0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:20.928120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a62f0-da88-4400-b306-dd34aa8c0e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:20.929323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a62f0-da88-4400-b306-dd34aa8c0e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:20.932530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a62f0-da88-4400-b306-dd34aa8c0e09 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:20.951936 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1354/2672] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:20.955994 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a62f0-da88-4400-b306-dd34aa8c0e09 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:20.974022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a62f0-da88-4400-b306-dd34aa8c0e09 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:20.975125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb41f1-6b1e-4a50-802b-348afdc4071d admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:20.984160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:20.984160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:20.984160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:20.984160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] PATH_INFO: `/v3/projects/479aac34b55846a4bbf175784bcaf4e1` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:20.985131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=479aac34b55846a4bbf175784bcaf4e1)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:20.985255 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8bdbe-049b-4707-8233-db021886ace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:20.985868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8bdbe-049b-4707-8233-db021886ace3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:20.986211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8bdbe-049b-4707-8233-db021886ace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:20.987450 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:20.988056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8bdbe-049b-4707-8233-db021886ace3 admin admin] PATH_INFO: `/v3/projects/8032e0380e6143f785074f693ea2e22f/users/173de8c4b5a04eb5906d9fc7360e16d6/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:20.994059 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8bdbe-049b-4707-8233-db021886ace3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8032e0380e6143f785074f693ea2e22f, user_id=173de8c4b5a04eb5906d9fc7360e16d6, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:20.999737 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8bdbe-049b-4707-8233-db021886ace3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:21.017423 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1355/2673] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:20 2022] PUT /identity/v3/projects/8032e0380e6143f785074f693ea2e22f/users/173de8c4b5a04eb5906d9fc7360e16d6/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:21.189828 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479aac34b55846a4bbf175784bcaf4e1', 'request_id': 'req-f07860f2-c204-4318-a68c-0b24a53c06c1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:21.283324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479aac34b55846a4bbf175784bcaf4e1', 'request_id': 'req-f07860f2-c204-4318-a68c-0b24a53c06c1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:21.291891 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479aac34b55846a4bbf175784bcaf4e1', 'request_id': 'req-f07860f2-c204-4318-a68c-0b24a53c06c1'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:21.325395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] The token cache is being invalidate because project 479aac34b55846a4bbf175784bcaf4e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:21.326303 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:21.327036 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f07860f2-c204-4318-a68c-0b24a53c06c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:21.328650 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1319/2674] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:20 2022] DELETE /identity/v3/projects/479aac34b55846a4bbf175784bcaf4e1 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:21.333890 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f5fb1-ca91-485d-aa57-4fd5969caa65 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:21.334288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f5fb1-ca91-485d-aa57-4fd5969caa65 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:21.334583 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f5fb1-ca91-485d-aa57-4fd5969caa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:21.372906 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b73f5fb1-ca91-485d-aa57-4fd5969caa65 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:21.376508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b73f5fb1-ca91-485d-aa57-4fd5969caa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:21.470049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1356/2675] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:21.478405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472f1c6-7a26-490e-ab63-50fe79f4e6b1 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:21.478405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472f1c6-7a26-490e-ab63-50fe79f4e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:21.478405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472f1c6-7a26-490e-ab63-50fe79f4e6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:21.518603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-8472f1c6-7a26-490e-ab63-50fe79f4e6b1 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:21.519765 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-8472f1c6-7a26-490e-ab63-50fe79f4e6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:21.552329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1320/2676] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:21.554319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f5fb1-ca91-485d-aa57-4fd5969caa65 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:21.566258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f5fb1-ca91-485d-aa57-4fd5969caa65 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:21.574727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70b51-d138-4f81-a671-ceba7baf975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:21.575782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70b51-d138-4f81-a671-ceba7baf975f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:21.576254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70b51-d138-4f81-a671-ceba7baf975f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:21.576730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70b51-d138-4f81-a671-ceba7baf975f admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:21.577584 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b70b51-d138-4f81-a671-ceba7baf975f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:21.578076 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b70b51-d138-4f81-a671-ceba7baf975f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:21.580141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b70b51-d138-4f81-a671-ceba7baf975f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:21.600187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1357/2677] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:21.605334 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472f1c6-7a26-490e-ab63-50fe79f4e6b1 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:21.617368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472f1c6-7a26-490e-ab63-50fe79f4e6b1 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:21.633232 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b4c0e-c3cb-4814-a495-e1aa71c925bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:21.635291 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b4c0e-c3cb-4814-a495-e1aa71c925bc admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:21.636424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b4c0e-c3cb-4814-a495-e1aa71c925bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:21.636918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b4c0e-c3cb-4814-a495-e1aa71c925bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:21.637760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b4c0e-c3cb-4814-a495-e1aa71c925bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:21.640031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b4c0e-c3cb-4814-a495-e1aa71c925bc admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:21.862459 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1321/2678] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:21 2022] POST /identity/v3/projects => generated 363 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:21.864407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70b51-d138-4f81-a671-ceba7baf975f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:21.876048 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70b51-d138-4f81-a671-ceba7baf975f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:21.973946 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d2426-59e1-48a6-a202-823a97f60989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:21.974673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d2426-59e1-48a6-a202-823a97f60989 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:21.975197 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d2426-59e1-48a6-a202-823a97f60989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:21.975618 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d2426-59e1-48a6-a202-823a97f60989 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:21.976258 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d2426-59e1-48a6-a202-823a97f60989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:21.978606 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d2426-59e1-48a6-a202-823a97f60989 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:22.124469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1358/2679] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:21 2022] POST /identity/v3/users => generated 282 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:22.129324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b4c0e-c3cb-4814-a495-e1aa71c925bc admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:22.146775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b4c0e-c3cb-4814-a495-e1aa71c925bc admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:22.164000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a773e9-b1b0-4b1a-9695-c0ad2b59756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:22.164634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a773e9-b1b0-4b1a-9695-c0ad2b59756f admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:22.164963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a773e9-b1b0-4b1a-9695-c0ad2b59756f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:22.165237 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a773e9-b1b0-4b1a-9695-c0ad2b59756f admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:22.167617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a773e9-b1b0-4b1a-9695-c0ad2b59756f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:22.184192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a773e9-b1b0-4b1a-9695-c0ad2b59756f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:22.213517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1322/2680] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:22.215072 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d2426-59e1-48a6-a202-823a97f60989 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:22.227174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:22.237371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d2426-59e1-48a6-a202-823a97f60989 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:22.250422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aba2f-28a5-4f15-8ceb-8bcd1f8fecb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:22.251179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aba2f-28a5-4f15-8ceb-8bcd1f8fecb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:22.251560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aba2f-28a5-4f15-8ceb-8bcd1f8fecb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:22.251935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aba2f-28a5-4f15-8ceb-8bcd1f8fecb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:22.252685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aba2f-28a5-4f15-8ceb-8bcd1f8fecb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:22.257013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aba2f-28a5-4f15-8ceb-8bcd1f8fecb3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:22.286361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1359/2681] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:22.291720 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a773e9-b1b0-4b1a-9695-c0ad2b59756f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:22.308153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a773e9-b1b0-4b1a-9695-c0ad2b59756f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:22.323604 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:22.325030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d6d00-24be-435e-b020-1f813e76b52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:22.325725 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d6d00-24be-435e-b020-1f813e76b52e admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:22.326160 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d6d00-24be-435e-b020-1f813e76b52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:22.328668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d6d00-24be-435e-b020-1f813e76b52e admin admin] PATH_INFO: `/v3/projects/04cdc19e5810486783829ac5f6e548ff/users/a5de3b372b3246029c13c49f7be8ca22/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:22.388086 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d6d00-24be-435e-b020-1f813e76b52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04cdc19e5810486783829ac5f6e548ff, user_id=a5de3b372b3246029c13c49f7be8ca22, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:22.394135 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d6d00-24be-435e-b020-1f813e76b52e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:22.541628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1323/2682] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:22 2022] PUT /identity/v3/projects/04cdc19e5810486783829ac5f6e548ff/users/a5de3b372b3246029c13c49f7be8ca22/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:22.554169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d3527-b918-4cf1-a357-5ffeed522b0c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:22.554653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d3527-b918-4cf1-a357-5ffeed522b0c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:22.555079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d3527-b918-4cf1-a357-5ffeed522b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:22.625163 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fb1d3527-b918-4cf1-a357-5ffeed522b0c None None] MFA Rules not processed for user `a5de3b372b3246029c13c49f7be8ca22`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:22.628292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fb1d3527-b918-4cf1-a357-5ffeed522b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:22.781428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1360/2683] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:22.786037 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d6d00-24be-435e-b020-1f813e76b52e admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:22.893388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d6d00-24be-435e-b020-1f813e76b52e admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:22.900508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530b0ff-9569-49e9-ba2c-0bc3c9c109dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:22.902721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b0ff-9569-49e9-ba2c-0bc3c9c109dd admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:22.903337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b0ff-9569-49e9-ba2c-0bc3c9c109dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:22.903826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b0ff-9569-49e9-ba2c-0bc3c9c109dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:22.904705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530b0ff-9569-49e9-ba2c-0bc3c9c109dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:22.907057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530b0ff-9569-49e9-ba2c-0bc3c9c109dd admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:22.918681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:22.961747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb643dc3-17e9-4b46-b155-242ff536d07c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:22.962389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb643dc3-17e9-4b46-b155-242ff536d07c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:22.962932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb643dc3-17e9-4b46-b155-242ff536d07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:23.017592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1324/2684] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:22 2022] POST /identity/v3/projects => generated 363 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:23.021180 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530b0ff-9569-49e9-ba2c-0bc3c9c109dd admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:23.028477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-cb643dc3-17e9-4b46-b155-242ff536d07c None None] MFA Rules not processed for user `173de8c4b5a04eb5906d9fc7360e16d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:23.030328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cb643dc3-17e9-4b46-b155-242ff536d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:23.198963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530b0ff-9569-49e9-ba2c-0bc3c9c109dd admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:23.224373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851dec5-42cf-4f08-9e1b-f5e6db6cef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:23.224896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851dec5-42cf-4f08-9e1b-f5e6db6cef5b admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:23.225186 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851dec5-42cf-4f08-9e1b-f5e6db6cef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:23.225466 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851dec5-42cf-4f08-9e1b-f5e6db6cef5b admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:23.226110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851dec5-42cf-4f08-9e1b-f5e6db6cef5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:23.226565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1361/2685] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:23.228002 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667e27-80b4-49ae-863d-fc209bfaf827 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:23.228141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851dec5-42cf-4f08-9e1b-f5e6db6cef5b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:23.228291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667e27-80b4-49ae-863d-fc209bfaf827 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:23.228771 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667e27-80b4-49ae-863d-fc209bfaf827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:23.278658 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d7667e27-80b4-49ae-863d-fc209bfaf827 None None] MFA Rules not processed for user `7e201fc6021b4e788af5441a2ffb0777`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:23.280176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d7667e27-80b4-49ae-863d-fc209bfaf827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:23.333799 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1325/2686] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:23 2022] POST /identity/v3/users => generated 288 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:23.338757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851dec5-42cf-4f08-9e1b-f5e6db6cef5b admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:23.362005 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851dec5-42cf-4f08-9e1b-f5e6db6cef5b admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:23.368144 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1362/2687] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:23.374424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2f63a-9f95-4c73-b65a-daca48e2789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:23.375111 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2f63a-9f95-4c73-b65a-daca48e2789f admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:23.375405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2f63a-9f95-4c73-b65a-daca48e2789f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:23.375685 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2f63a-9f95-4c73-b65a-daca48e2789f admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:23.376477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2f63a-9f95-4c73-b65a-daca48e2789f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:23.378557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2f63a-9f95-4c73-b65a-daca48e2789f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:23.390047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667e27-80b4-49ae-863d-fc209bfaf827 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:23.391459 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d7667e27-80b4-49ae-863d-fc209bfaf827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:23.417253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1326/2688] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:23.422506 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2f63a-9f95-4c73-b65a-daca48e2789f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:23.445712 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2f63a-9f95-4c73-b65a-daca48e2789f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:23.459157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d55913-bc92-4b5e-8dd5-6f547ada4c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:23.459996 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d55913-bc92-4b5e-8dd5-6f547ada4c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:23.460285 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d55913-bc92-4b5e-8dd5-6f547ada4c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:23.460569 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d55913-bc92-4b5e-8dd5-6f547ada4c26 admin admin] PATH_INFO: `/v3/projects/90205e30b67b43f0bdfe0ec75e5e49be/users/6c68a4b74277464e93ceba94925893b5/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:23.471924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:23.504999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d55913-bc92-4b5e-8dd5-6f547ada4c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90205e30b67b43f0bdfe0ec75e5e49be, user_id=6c68a4b74277464e93ceba94925893b5, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:23.512628 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:23.514108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d55913-bc92-4b5e-8dd5-6f547ada4c26 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:23.582912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667e27-80b4-49ae-863d-fc209bfaf827 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:23.597918 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335466f-cba0-4947-80ba-25c990e00740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:23.609342 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335466f-cba0-4947-80ba-25c990e00740 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:23.609887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335466f-cba0-4947-80ba-25c990e00740 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:23.610410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335466f-cba0-4947-80ba-25c990e00740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:23.624302 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7335466f-cba0-4947-80ba-25c990e00740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:23.645307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335466f-cba0-4947-80ba-25c990e00740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:23.646969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335466f-cba0-4947-80ba-25c990e00740 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:23.672698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1327/2689] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:23 2022] PUT /identity/v3/projects/90205e30b67b43f0bdfe0ec75e5e49be/users/6c68a4b74277464e93ceba94925893b5/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:23.674546 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d55913-bc92-4b5e-8dd5-6f547ada4c26 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:23.682854 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1363/2690] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:23.895536 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d55913-bc92-4b5e-8dd5-6f547ada4c26 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:23.914879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a54d5-54b6-4653-a471-cdd6ad88b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:23.915511 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a54d5-54b6-4653-a471-cdd6ad88b5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:23.915792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a54d5-54b6-4653-a471-cdd6ad88b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:23.916994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a54d5-54b6-4653-a471-cdd6ad88b5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:23.917808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a54d5-54b6-4653-a471-cdd6ad88b5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:23.923010 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a54d5-54b6-4653-a471-cdd6ad88b5d2 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:23.951628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1328/2691] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:23.955810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335466f-cba0-4947-80ba-25c990e00740 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:23.974778 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335466f-cba0-4947-80ba-25c990e00740 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:23.986806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ef1ec-2551-4d61-b75b-46cb7dd7ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:23.987600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ef1ec-2551-4d61-b75b-46cb7dd7ff5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:23.989774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ef1ec-2551-4d61-b75b-46cb7dd7ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:23.991169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ef1ec-2551-4d61-b75b-46cb7dd7ff5d admin admin] PATH_INFO: `/v3/projects/90205e30b67b43f0bdfe0ec75e5e49be/users/6c68a4b74277464e93ceba94925893b5/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:23.999195 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ef1ec-2551-4d61-b75b-46cb7dd7ff5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90205e30b67b43f0bdfe0ec75e5e49be, user_id=6c68a4b74277464e93ceba94925893b5, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:24.006292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ef1ec-2551-4d61-b75b-46cb7dd7ff5d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:24.027267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1364/2692] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:23 2022] PUT /identity/v3/projects/90205e30b67b43f0bdfe0ec75e5e49be/users/6c68a4b74277464e93ceba94925893b5/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:24.037355 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10f90f-ab44-4566-addc-ac18ba885b9e None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:24.037729 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10f90f-ab44-4566-addc-ac18ba885b9e None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:24.038011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10f90f-ab44-4566-addc-ac18ba885b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:24.099142 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-bb10f90f-ab44-4566-addc-ac18ba885b9e None None] MFA Rules not processed for user `6c68a4b74277464e93ceba94925893b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:24.100409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-bb10f90f-ab44-4566-addc-ac18ba885b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:24.326103 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1329/2693] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:24.333990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ef1ec-2551-4d61-b75b-46cb7dd7ff5d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:24.335765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d12ef1ec-2551-4d61-b75b-46cb7dd7ff5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:24.441594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ef1ec-2551-4d61-b75b-46cb7dd7ff5d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:24.445642 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df397e-4fc3-4fc7-9e83-6d40ceb9cd43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:24.446615 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df397e-4fc3-4fc7-9e83-6d40ceb9cd43 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:24.446914 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df397e-4fc3-4fc7-9e83-6d40ceb9cd43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:24.455026 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df397e-4fc3-4fc7-9e83-6d40ceb9cd43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:24.460605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df397e-4fc3-4fc7-9e83-6d40ceb9cd43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:24.462595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df397e-4fc3-4fc7-9e83-6d40ceb9cd43 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:24.469779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:24.477686 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1365/2694] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:24.495599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=93,keystone:DELETE=1,keystone:INSERT=6 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:26.319456 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10f90f-ab44-4566-addc-ac18ba885b9e None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:26.402808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10f90f-ab44-4566-addc-ac18ba885b9e None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:26.407899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:26.408811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:26.409094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:26.409369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] PATH_INFO: `/v3/users/a5de3b372b3246029c13c49f7be8ca22` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:26.413045 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5de3b372b3246029c13c49f7be8ca22)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:26.414886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:26.638227 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:26.658736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5de3b372b3246029c13c49f7be8ca22'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:26.678311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5de3b372b3246029c13c49f7be8ca22'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:26.768721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5de3b372b3246029c13c49f7be8ca22'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:26.781997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5de3b372b3246029c13c49f7be8ca22'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:26.783007 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5de3b372b3246029c13c49f7be8ca22'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:26.790300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1330/2695] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:26 2022] DELETE /identity/v3/users/a5de3b372b3246029c13c49f7be8ca22 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:26.795718 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b3384-f917-45c3-b88a-e68caa0bac9e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:26.796214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b3384-f917-45c3-b88a-e68caa0bac9e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:26.796328 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b3384-f917-45c3-b88a-e68caa0bac9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:26.831519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-386b3384-f917-45c3-b88a-e68caa0bac9e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:26.832797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-386b3384-f917-45c3-b88a-e68caa0bac9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:26.911536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1366/2696] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:26.921977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:26.923454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:26.989340 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e46109-16d3-45ca-8309-2eea6165a1bb admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:27.013563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901ab8d-ea25-4faf-9f03-af5e894b95d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:27.014667 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901ab8d-ea25-4faf-9f03-af5e894b95d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:27.015295 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901ab8d-ea25-4faf-9f03-af5e894b95d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:27.018670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901ab8d-ea25-4faf-9f03-af5e894b95d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:27.051436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901ab8d-ea25-4faf-9f03-af5e894b95d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:27.053067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901ab8d-ea25-4faf-9f03-af5e894b95d3 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:27.067912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1331/2697] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:27.627782 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b3384-f917-45c3-b88a-e68caa0bac9e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:27.629260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-386b3384-f917-45c3-b88a-e68caa0bac9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:27.643442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b3384-f917-45c3-b88a-e68caa0bac9e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:27.649345 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:27.650570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:27.650764 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:27.650915 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] PATH_INFO: `/v3/projects/04cdc19e5810486783829ac5f6e548ff` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:27.652335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=04cdc19e5810486783829ac5f6e548ff)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:27.654520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:27.791166 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04cdc19e5810486783829ac5f6e548ff', 'request_id': 'req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:27.800932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04cdc19e5810486783829ac5f6e548ff', 'request_id': 'req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:27.877785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04cdc19e5810486783829ac5f6e548ff', 'request_id': 'req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:27.890827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] The token cache is being invalidate because project 04cdc19e5810486783829ac5f6e548ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:27.891120 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:27.891753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:27.893603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1367/2698] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:27 2022] DELETE /identity/v3/projects/04cdc19e5810486783829ac5f6e548ff => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:27.897284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901ab8d-ea25-4faf-9f03-af5e894b95d3 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:27.908335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901ab8d-ea25-4faf-9f03-af5e894b95d3 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:28.009683 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:28.010692 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:28.010983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:28.011258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] PATH_INFO: `/v3/users/6c68a4b74277464e93ceba94925893b5` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:28.012405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c68a4b74277464e93ceba94925893b5)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:28.014486 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:28.023411 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:28.434269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c68a4b74277464e93ceba94925893b5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:28.452270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c68a4b74277464e93ceba94925893b5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:28.819216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c68a4b74277464e93ceba94925893b5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:28.828563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c68a4b74277464e93ceba94925893b5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:28.829453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-591a1a01-d4f1-4a74-b5cd-d93d9b6c3765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c68a4b74277464e93ceba94925893b5'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:28.842510 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1332/2699] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:27 2022] DELETE /identity/v3/users/6c68a4b74277464e93ceba94925893b5 => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:29.601044 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:29.602880 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:29.622449 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0bb6a-e855-400c-8f92-bbdc124b5d3d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:29.698587 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:29.699269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:29.699553 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:29.699827 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] PATH_INFO: `/v3/projects/90205e30b67b43f0bdfe0ec75e5e49be` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:29.701001 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90205e30b67b43f0bdfe0ec75e5e49be)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:29.702998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:29.841080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:29.861932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90205e30b67b43f0bdfe0ec75e5e49be', 'request_id': 'req-805c0d68-4066-4991-ab34-a6aec06a4915'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:29.869225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90205e30b67b43f0bdfe0ec75e5e49be', 'request_id': 'req-805c0d68-4066-4991-ab34-a6aec06a4915'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:29.999577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90205e30b67b43f0bdfe0ec75e5e49be', 'request_id': 'req-805c0d68-4066-4991-ab34-a6aec06a4915'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:30.012861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] The token cache is being invalidate because project 90205e30b67b43f0bdfe0ec75e5e49be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:30.013311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:30.013988 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-805c0d68-4066-4991-ab34-a6aec06a4915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:30.018916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1368/2700] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:29 2022] DELETE /identity/v3/projects/90205e30b67b43f0bdfe0ec75e5e49be => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:30.021293 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2573d-0689-4184-86c3-c17cd3e058de None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:30.022235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2573d-0689-4184-86c3-c17cd3e058de None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:30.022726 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2573d-0689-4184-86c3-c17cd3e058de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:30.044868 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-72a2573d-0689-4184-86c3-c17cd3e058de None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:30.052224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-72a2573d-0689-4184-86c3-c17cd3e058de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:30.149430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1333/2701] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:30.152901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78798d8b-3509-4c67-b34b-6499472d047d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:30.153378 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78798d8b-3509-4c67-b34b-6499472d047d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:30.153821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78798d8b-3509-4c67-b34b-6499472d047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:30.192092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-78798d8b-3509-4c67-b34b-6499472d047d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:30.194998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-78798d8b-3509-4c67-b34b-6499472d047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:30.213795 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1369/2702] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:30.215214 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2573d-0689-4184-86c3-c17cd3e058de None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:30.226646 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2573d-0689-4184-86c3-c17cd3e058de None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:30.233961 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda00e-1ba4-449f-9cfb-33849a7e0115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:30.234728 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda00e-1ba4-449f-9cfb-33849a7e0115 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:30.235131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda00e-1ba4-449f-9cfb-33849a7e0115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:30.235555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda00e-1ba4-449f-9cfb-33849a7e0115 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:30.236353 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eda00e-1ba4-449f-9cfb-33849a7e0115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:30.236754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eda00e-1ba4-449f-9cfb-33849a7e0115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:30.241304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eda00e-1ba4-449f-9cfb-33849a7e0115 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:30.262163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1334/2703] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:30.263737 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78798d8b-3509-4c67-b34b-6499472d047d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:30.277729 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78798d8b-3509-4c67-b34b-6499472d047d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:30.291042 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61dd92-fc43-44eb-9be0-82358bc4f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:30.291918 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61dd92-fc43-44eb-9be0-82358bc4f12b admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:30.292288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61dd92-fc43-44eb-9be0-82358bc4f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:30.292678 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61dd92-fc43-44eb-9be0-82358bc4f12b admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:30.293392 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61dd92-fc43-44eb-9be0-82358bc4f12b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:30.295913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61dd92-fc43-44eb-9be0-82358bc4f12b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:30.411003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1370/2704] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:30 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:30.415206 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda00e-1ba4-449f-9cfb-33849a7e0115 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:30.425735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda00e-1ba4-449f-9cfb-33849a7e0115 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:30.496091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec44c7-92d9-4546-a3c4-8bd791560a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:30.496762 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec44c7-92d9-4546-a3c4-8bd791560a27 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:30.497079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec44c7-92d9-4546-a3c4-8bd791560a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:30.497471 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec44c7-92d9-4546-a3c4-8bd791560a27 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:30.498224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec44c7-92d9-4546-a3c4-8bd791560a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:30.500741 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec44c7-92d9-4546-a3c4-8bd791560a27 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:30.710480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1335/2705] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:30 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:30.714437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61dd92-fc43-44eb-9be0-82358bc4f12b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:30.728962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61dd92-fc43-44eb-9be0-82358bc4f12b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:30.740113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b6522-4ef6-495f-b4a0-42ede967ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:30.740113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b6522-4ef6-495f-b4a0-42ede967ecec admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:30.740113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b6522-4ef6-495f-b4a0-42ede967ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:30.740113 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b6522-4ef6-495f-b4a0-42ede967ecec admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:30.740540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b6522-4ef6-495f-b4a0-42ede967ecec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:30.741459 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b6522-4ef6-495f-b4a0-42ede967ecec admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:30.761413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1371/2706] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:30.764132 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec44c7-92d9-4546-a3c4-8bd791560a27 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:30.770448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:30.780127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec44c7-92d9-4546-a3c4-8bd791560a27 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:30.793677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42435f18-6589-41bc-a17e-9fcfc7a4bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:30.795225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42435f18-6589-41bc-a17e-9fcfc7a4bf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:30.796180 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42435f18-6589-41bc-a17e-9fcfc7a4bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:30.796563 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42435f18-6589-41bc-a17e-9fcfc7a4bf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:30.797373 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42435f18-6589-41bc-a17e-9fcfc7a4bf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:30.799130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42435f18-6589-41bc-a17e-9fcfc7a4bf2e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:30.831292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1336/2707] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:30.836062 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b6522-4ef6-495f-b4a0-42ede967ecec admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:30.851491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b6522-4ef6-495f-b4a0-42ede967ecec admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:30.863495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e67e7-98f4-47de-b05b-311c7d7c8b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:30.864284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e67e7-98f4-47de-b05b-311c7d7c8b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:30.864571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e67e7-98f4-47de-b05b-311c7d7c8b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:30.864849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e67e7-98f4-47de-b05b-311c7d7c8b08 admin admin] PATH_INFO: `/v3/projects/119a3851977042d497c850a168f63126/users/a6a3b1283c514f97a47e0e5824b954ac/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:30.886122 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e67e7-98f4-47de-b05b-311c7d7c8b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119a3851977042d497c850a168f63126, user_id=a6a3b1283c514f97a47e0e5824b954ac, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:30.889417 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e67e7-98f4-47de-b05b-311c7d7c8b08 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:30.975205 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1372/2708] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:30 2022] PUT /identity/v3/projects/119a3851977042d497c850a168f63126/users/a6a3b1283c514f97a47e0e5824b954ac/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:30.988586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220e4de-20b8-48d8-9d6f-663ce9b282bd None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:30.988586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220e4de-20b8-48d8-9d6f-663ce9b282bd None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:30.988886 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220e4de-20b8-48d8-9d6f-663ce9b282bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:31.031094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-6220e4de-20b8-48d8-9d6f-663ce9b282bd None None] MFA Rules not processed for user `a6a3b1283c514f97a47e0e5824b954ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:31.033224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6220e4de-20b8-48d8-9d6f-663ce9b282bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:31.144946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1337/2709] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:31.149535 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e67e7-98f4-47de-b05b-311c7d7c8b08 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:31.253462 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e67e7-98f4-47de-b05b-311c7d7c8b08 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:31.271336 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a21f-49be-4ffb-8c27-4a3776dd7dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:31.272540 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a21f-49be-4ffb-8c27-4a3776dd7dcb admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:31.273063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a21f-49be-4ffb-8c27-4a3776dd7dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:31.273596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a21f-49be-4ffb-8c27-4a3776dd7dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:31.278324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858a21f-49be-4ffb-8c27-4a3776dd7dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:31.282835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858a21f-49be-4ffb-8c27-4a3776dd7dcb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:31.384879 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1373/2710] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:31 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:31.389289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220e4de-20b8-48d8-9d6f-663ce9b282bd None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:31.408754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220e4de-20b8-48d8-9d6f-663ce9b282bd None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:31.485250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426446ae-61b0-442f-8304-e1551bd618e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:31.485991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426446ae-61b0-442f-8304-e1551bd618e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:31.486378 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426446ae-61b0-442f-8304-e1551bd618e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:31.486752 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426446ae-61b0-442f-8304-e1551bd618e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:31.487949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426446ae-61b0-442f-8304-e1551bd618e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:31.490468 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426446ae-61b0-442f-8304-e1551bd618e5 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:31.597564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a21f-49be-4ffb-8c27-4a3776dd7dcb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:31.597931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1338/2711] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:31 2022] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:31.617514 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a21f-49be-4ffb-8c27-4a3776dd7dcb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:31.632901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152b513-9e62-4016-82d7-024b1d384396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:31.633640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152b513-9e62-4016-82d7-024b1d384396 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:31.633973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152b513-9e62-4016-82d7-024b1d384396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:31.634401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152b513-9e62-4016-82d7-024b1d384396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:31.635722 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152b513-9e62-4016-82d7-024b1d384396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:31.641616 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152b513-9e62-4016-82d7-024b1d384396 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:31.667760 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1374/2712] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:31.671997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426446ae-61b0-442f-8304-e1551bd618e5 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:31.689298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426446ae-61b0-442f-8304-e1551bd618e5 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:31.697570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda0fa8-307f-4ce7-a87c-af4a09312760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:31.698611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0fa8-307f-4ce7-a87c-af4a09312760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:31.701083 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0fa8-307f-4ce7-a87c-af4a09312760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:31.701083 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0fa8-307f-4ce7-a87c-af4a09312760 admin admin] PATH_INFO: `/v3/projects/ac0847a5226d484b9c8d7605b53c01ca/users/41813dbd5fea4d6b97691482d1788cfc/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:31.718121 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda0fa8-307f-4ce7-a87c-af4a09312760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0847a5226d484b9c8d7605b53c01ca, user_id=41813dbd5fea4d6b97691482d1788cfc, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:31.721012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda0fa8-307f-4ce7-a87c-af4a09312760 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:31.802906 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1339/2713] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:31 2022] PUT /identity/v3/projects/ac0847a5226d484b9c8d7605b53c01ca/users/41813dbd5fea4d6b97691482d1788cfc/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:31.804361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152b513-9e62-4016-82d7-024b1d384396 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:31.821104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152b513-9e62-4016-82d7-024b1d384396 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:31.870537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:32.079407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e0a0b-5ce7-4e68-8f2c-0cdc95da4c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:32.080294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0a0b-5ce7-4e68-8f2c-0cdc95da4c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:32.081029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0a0b-5ce7-4e68-8f2c-0cdc95da4c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:32.085901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0a0b-5ce7-4e68-8f2c-0cdc95da4c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:32.086697 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e0a0b-5ce7-4e68-8f2c-0cdc95da4c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:32.088721 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e0a0b-5ce7-4e68-8f2c-0cdc95da4c75 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:32.101263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1375/2714] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:32.107271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda0fa8-307f-4ce7-a87c-af4a09312760 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:32.121384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda0fa8-307f-4ce7-a87c-af4a09312760 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:32.126528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181617d-114b-421a-8b86-9226b7ee911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:32.127375 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181617d-114b-421a-8b86-9226b7ee911e admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:32.127660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181617d-114b-421a-8b86-9226b7ee911e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:32.127931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181617d-114b-421a-8b86-9226b7ee911e admin admin] PATH_INFO: `/v3/projects/ac0847a5226d484b9c8d7605b53c01ca/users/41813dbd5fea4d6b97691482d1788cfc/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:32.129837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181617d-114b-421a-8b86-9226b7ee911e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0847a5226d484b9c8d7605b53c01ca, user_id=41813dbd5fea4d6b97691482d1788cfc, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:32.132470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181617d-114b-421a-8b86-9226b7ee911e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:32.151114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1340/2715] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:32 2022] PUT /identity/v3/projects/ac0847a5226d484b9c8d7605b53c01ca/users/41813dbd5fea4d6b97691482d1788cfc/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:32.161707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8e47b-01fb-436e-ba2e-c5ca1729307b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:32.161707 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8e47b-01fb-436e-ba2e-c5ca1729307b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:32.162561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8e47b-01fb-436e-ba2e-c5ca1729307b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:32.205150 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-29d8e47b-01fb-436e-ba2e-c5ca1729307b None None] MFA Rules not processed for user `41813dbd5fea4d6b97691482d1788cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:32.206571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-29d8e47b-01fb-436e-ba2e-c5ca1729307b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:32.288248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1376/2716] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:32.306104 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181617d-114b-421a-8b86-9226b7ee911e admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:32.309174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1181617d-114b-421a-8b86-9226b7ee911e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:32.354230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:32.381500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181617d-114b-421a-8b86-9226b7ee911e admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:32.386490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fa5be-aab1-4bde-b440-ffef6e75194c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:32.387133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fa5be-aab1-4bde-b440-ffef6e75194c service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:32.387417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fa5be-aab1-4bde-b440-ffef6e75194c service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:32.387694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fa5be-aab1-4bde-b440-ffef6e75194c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:32.450169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fa5be-aab1-4bde-b440-ffef6e75194c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:32.451806 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fa5be-aab1-4bde-b440-ffef6e75194c service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:32.461946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1341/2717] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:34.259299 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335614f-ec70-4f97-93a7-a2f3b80692f0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:34.260393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335614f-ec70-4f97-93a7-a2f3b80692f0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:34.260393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335614f-ec70-4f97-93a7-a2f3b80692f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:34.284297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3335614f-ec70-4f97-93a7-a2f3b80692f0 None None] MFA Rules not processed for user `098e78dc604b4f5ab1e92a21baa4f3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:34.289291 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3335614f-ec70-4f97-93a7-a2f3b80692f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:34.359570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1377/2718] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:36.176570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fa5be-aab1-4bde-b440-ffef6e75194c service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:36.186405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fa5be-aab1-4bde-b440-ffef6e75194c service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:36.190396 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b949e1-2b35-4a30-b88b-a72bded60dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:36.191167 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b949e1-2b35-4a30-b88b-a72bded60dbe service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:36.191512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b949e1-2b35-4a30-b88b-a72bded60dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:36.191842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b949e1-2b35-4a30-b88b-a72bded60dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:36.209779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b949e1-2b35-4a30-b88b-a72bded60dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:36.209779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b949e1-2b35-4a30-b88b-a72bded60dbe service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:36.217869 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1342/2719] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:39.274922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335614f-ec70-4f97-93a7-a2f3b80692f0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:39.276979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3335614f-ec70-4f97-93a7-a2f3b80692f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:39.350231 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335614f-ec70-4f97-93a7-a2f3b80692f0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:39.353363 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2613d1b-ad9a-4593-81c4-efa213697f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:39.354820 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613d1b-ad9a-4593-81c4-efa213697f5a service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:39.355181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613d1b-ad9a-4593-81c4-efa213697f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:39.355524 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613d1b-ad9a-4593-81c4-efa213697f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:39.357567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a2613d1b-ad9a-4593-81c4-efa213697f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:39.363020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:39.452234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2613d1b-ad9a-4593-81c4-efa213697f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:39.453833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2613d1b-ad9a-4593-81c4-efa213697f5a service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:39.479666 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1378/2720] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:39.550051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404eb12-70ff-41fc-938d-15586f2d9e60 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:39.550603 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404eb12-70ff-41fc-938d-15586f2d9e60 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:39.550719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404eb12-70ff-41fc-938d-15586f2d9e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:39.575316 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-0404eb12-70ff-41fc-938d-15586f2d9e60 None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:39.576756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0404eb12-70ff-41fc-938d-15586f2d9e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:39.639721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1343/2721] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 22 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:39.652588 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2613d1b-ad9a-4593-81c4-efa213697f5a service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:39.654146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a2613d1b-ad9a-4593-81c4-efa213697f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:39.769437 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2613d1b-ad9a-4593-81c4-efa213697f5a service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:39.781428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46618ef0-73a8-4bcf-b507-d322b34f1858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:39.782359 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618ef0-73a8-4bcf-b507-d322b34f1858 service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:39.784600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618ef0-73a8-4bcf-b507-d322b34f1858 service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:39.784600 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618ef0-73a8-4bcf-b507-d322b34f1858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:39.795136 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46618ef0-73a8-4bcf-b507-d322b34f1858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:39.797079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46618ef0-73a8-4bcf-b507-d322b34f1858 service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:39.812237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1379/2722] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:54:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:54:42.527306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404eb12-70ff-41fc-938d-15586f2d9e60 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:42.527306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0404eb12-70ff-41fc-938d-15586f2d9e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:42.530914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404eb12-70ff-41fc-938d-15586f2d9e60 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:42.534599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d40d91-538d-4326-bbb6-abfabbe4f801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:42.535306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d40d91-538d-4326-bbb6-abfabbe4f801 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:42.535767 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d40d91-538d-4326-bbb6-abfabbe4f801 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:42.536108 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d40d91-538d-4326-bbb6-abfabbe4f801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:42.538266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-99d40d91-538d-4326-bbb6-abfabbe4f801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:42.607597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d40d91-538d-4326-bbb6-abfabbe4f801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:42.609169 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d40d91-538d-4326-bbb6-abfabbe4f801 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:42.620020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1344/2723] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:49.804981 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=57 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:52.615093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=94 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:53.110094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46618ef0-73a8-4bcf-b507-d322b34f1858 service swift] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:53.190287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46618ef0-73a8-4bcf-b507-d322b34f1858 service swift] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:53.195171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:53.196909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:53.196909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:53.196909 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] PATH_INFO: `/v3/users/a6a3b1283c514f97a47e0e5824b954ac` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:53.197529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a3b1283c514f97a47e0e5824b954ac)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:53.199746 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:53.402393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a3b1283c514f97a47e0e5824b954ac'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:53.403096 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a3b1283c514f97a47e0e5824b954ac'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:53.410798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a3b1283c514f97a47e0e5824b954ac'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:53.423902 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a3b1283c514f97a47e0e5824b954ac'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:53.570234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a3b1283c514f97a47e0e5824b954ac'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:53.578323 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1380/2724] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:53 2022] DELETE /identity/v3/users/a6a3b1283c514f97a47e0e5824b954ac => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:53.582883 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c668-fd5e-4314-8bc8-b016410c1378 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:53.589213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c668-fd5e-4314-8bc8-b016410c1378 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:53.589213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c668-fd5e-4314-8bc8-b016410c1378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:53.607670 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-33a8c668-fd5e-4314-8bc8-b016410c1378 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:53.609163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-33a8c668-fd5e-4314-8bc8-b016410c1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:53.686648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1345/2725] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:53.699133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:53.701272 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:53.768446 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d9d21-e514-40eb-addb-9c7ed270166b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:53.772785 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2223ba1-0fbf-4402-a9b0-d6113f4ba59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:53.778184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2223ba1-0fbf-4402-a9b0-d6113f4ba59e service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:53.778184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2223ba1-0fbf-4402-a9b0-d6113f4ba59e service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:53.778184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2223ba1-0fbf-4402-a9b0-d6113f4ba59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:53.784247 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2223ba1-0fbf-4402-a9b0-d6113f4ba59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:53.785812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2223ba1-0fbf-4402-a9b0-d6113f4ba59e service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:53.796313 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1381/2726] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:54.313427 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8c668-fd5e-4314-8bc8-b016410c1378 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:54.315787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-33a8c668-fd5e-4314-8bc8-b016410c1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:54.332202 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8c668-fd5e-4314-8bc8-b016410c1378 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:54.339125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:54.343052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:54.343052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:54.343052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] PATH_INFO: `/v3/projects/119a3851977042d497c850a168f63126` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:54.343052 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119a3851977042d497c850a168f63126)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:54.344259 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:54.494469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119a3851977042d497c850a168f63126', 'request_id': 'req-c863f4fe-8663-4403-8e9c-348d589bb1e9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:54.607861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119a3851977042d497c850a168f63126', 'request_id': 'req-c863f4fe-8663-4403-8e9c-348d589bb1e9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:54.614944 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119a3851977042d497c850a168f63126', 'request_id': 'req-c863f4fe-8663-4403-8e9c-348d589bb1e9'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:54.632009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] The token cache is being invalidate because project 119a3851977042d497c850a168f63126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:54.632302 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:54.632967 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:54.634826 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1346/2727] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:54 2022] DELETE /identity/v3/projects/119a3851977042d497c850a168f63126 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:54.640686 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2223ba1-0fbf-4402-a9b0-d6113f4ba59e service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:54.652081 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2223ba1-0fbf-4402-a9b0-d6113f4ba59e service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:54.673398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:54.713850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:54.714970 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:54.715330 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:54.715617 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] PATH_INFO: `/v3/users/41813dbd5fea4d6b97691482d1788cfc` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:54.717028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=41813dbd5fea4d6b97691482d1788cfc)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:54.718980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:54.926999 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41813dbd5fea4d6b97691482d1788cfc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:54.927651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41813dbd5fea4d6b97691482d1788cfc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:54.935061 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41813dbd5fea4d6b97691482d1788cfc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:54.948757 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41813dbd5fea4d6b97691482d1788cfc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:55.042171 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-092fcfd1-045f-4842-9281-148adf5ac97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41813dbd5fea4d6b97691482d1788cfc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:55.052424 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1382/2728] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:54 2022] DELETE /identity/v3/users/41813dbd5fea4d6b97691482d1788cfc => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:56.418455 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:56.419976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:56.434404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863f4fe-8663-4403-8e9c-348d589bb1e9 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:56.507366 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:56.508711 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:56.508983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:56.509252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] PATH_INFO: `/v3/projects/ac0847a5226d484b9c8d7605b53c01ca` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:56.513415 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0847a5226d484b9c8d7605b53c01ca)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:56.515434 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:56.645990 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:56.670179 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0847a5226d484b9c8d7605b53c01ca', 'request_id': 'req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:56.768093 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0847a5226d484b9c8d7605b53c01ca', 'request_id': 'req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:56.774032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0847a5226d484b9c8d7605b53c01ca', 'request_id': 'req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:56.785884 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] The token cache is being invalidate because project ac0847a5226d484b9c8d7605b53c01ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:56.786178 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:56.786864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6d5c83cc-1354-408c-bb0b-3f95f656b6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:56.788337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1347/2729] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:56 2022] DELETE /identity/v3/projects/ac0847a5226d484b9c8d7605b53c01ca => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:56.794123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f9f35-1670-4b04-9bda-1388fbf3bfe6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:56.794651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f9f35-1670-4b04-9bda-1388fbf3bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:56.794770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f9f35-1670-4b04-9bda-1388fbf3bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:56.813962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-df5f9f35-1670-4b04-9bda-1388fbf3bfe6 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:56.815199 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-df5f9f35-1670-4b04-9bda-1388fbf3bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:56.874301 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1383/2730] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:56.883053 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea25d6-8a03-423e-96b2-8af034621310 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:56.883341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea25d6-8a03-423e-96b2-8af034621310 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:56.883611 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea25d6-8a03-423e-96b2-8af034621310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:56.904071 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-25ea25d6-8a03-423e-96b2-8af034621310 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:56.905301 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-25ea25d6-8a03-423e-96b2-8af034621310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:56.913150 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1348/2731] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:56.918057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f9f35-1670-4b04-9bda-1388fbf3bfe6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:56.930059 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f9f35-1670-4b04-9bda-1388fbf3bfe6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:56.932650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819326f0-0b58-4f1d-8455-59ed892f2ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:56.933261 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819326f0-0b58-4f1d-8455-59ed892f2ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:56.933541 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819326f0-0b58-4f1d-8455-59ed892f2ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:56.933821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819326f0-0b58-4f1d-8455-59ed892f2ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:56.934497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819326f0-0b58-4f1d-8455-59ed892f2ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:56.934807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819326f0-0b58-4f1d-8455-59ed892f2ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:56.936471 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819326f0-0b58-4f1d-8455-59ed892f2ba7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:56.950088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1384/2732] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:56.954695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea25d6-8a03-423e-96b2-8af034621310 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:56.964787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea25d6-8a03-423e-96b2-8af034621310 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:56.969172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500c031-1dbf-4aa3-8efe-8bafe98777b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:56.969795 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500c031-1dbf-4aa3-8efe-8bafe98777b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:56.970092 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500c031-1dbf-4aa3-8efe-8bafe98777b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:56.970388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500c031-1dbf-4aa3-8efe-8bafe98777b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:56.971013 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500c031-1dbf-4aa3-8efe-8bafe98777b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:56.972882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500c031-1dbf-4aa3-8efe-8bafe98777b7 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:57.115970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1349/2733] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:56 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:57.120366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819326f0-0b58-4f1d-8455-59ed892f2ba7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:57.132887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819326f0-0b58-4f1d-8455-59ed892f2ba7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:57.165734 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:57.212954 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4e5d3-57a6-4d6f-8c63-5413343ede86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:57.213703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4e5d3-57a6-4d6f-8c63-5413343ede86 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:57.217396 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4e5d3-57a6-4d6f-8c63-5413343ede86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:57.217724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4e5d3-57a6-4d6f-8c63-5413343ede86 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:57.218598 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4e5d3-57a6-4d6f-8c63-5413343ede86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:57.220559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4e5d3-57a6-4d6f-8c63-5413343ede86 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:57.324830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1385/2734] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:57 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:57.328946 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500c031-1dbf-4aa3-8efe-8bafe98777b7 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:57.341275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500c031-1dbf-4aa3-8efe-8bafe98777b7 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:57.346304 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747105b-419a-4c9e-9f00-ff1903160776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:57.347031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747105b-419a-4c9e-9f00-ff1903160776 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:57.347429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747105b-419a-4c9e-9f00-ff1903160776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:57.347921 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747105b-419a-4c9e-9f00-ff1903160776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:57.348631 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747105b-419a-4c9e-9f00-ff1903160776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:57.350494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747105b-419a-4c9e-9f00-ff1903160776 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:57.364153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1350/2735] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:57.374374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4e5d3-57a6-4d6f-8c63-5413343ede86 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:57.386003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4e5d3-57a6-4d6f-8c63-5413343ede86 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:57.391701 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209ae5a-424f-4a63-88c5-27e7dc78232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:57.392385 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209ae5a-424f-4a63-88c5-27e7dc78232b admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:57.392683 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209ae5a-424f-4a63-88c5-27e7dc78232b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:57.392934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209ae5a-424f-4a63-88c5-27e7dc78232b admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:57.393581 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209ae5a-424f-4a63-88c5-27e7dc78232b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:57.395340 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209ae5a-424f-4a63-88c5-27e7dc78232b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:57.406883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1386/2736] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:57.412609 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747105b-419a-4c9e-9f00-ff1903160776 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:57.433103 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747105b-419a-4c9e-9f00-ff1903160776 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:57.439813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201effa-d35b-4bb0-8404-66cbccc6eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:57.440916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201effa-d35b-4bb0-8404-66cbccc6eeb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:57.441256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201effa-d35b-4bb0-8404-66cbccc6eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:57.441543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201effa-d35b-4bb0-8404-66cbccc6eeb1 admin admin] PATH_INFO: `/v3/projects/1757333b615e49aa852242f2edd28db9/users/24bf4c7eae174cbc93fa1bea22a79d89/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:57.458280 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201effa-d35b-4bb0-8404-66cbccc6eeb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1757333b615e49aa852242f2edd28db9, user_id=24bf4c7eae174cbc93fa1bea22a79d89, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:57.460951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201effa-d35b-4bb0-8404-66cbccc6eeb1 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:57.563022 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1351/2737] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:57 2022] PUT /identity/v3/projects/1757333b615e49aa852242f2edd28db9/users/24bf4c7eae174cbc93fa1bea22a79d89/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:57.573640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ac41b-83e9-4fa7-8fb0-eb1c65d11956 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:57.573923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ac41b-83e9-4fa7-8fb0-eb1c65d11956 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:57.574235 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ac41b-83e9-4fa7-8fb0-eb1c65d11956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:57.603715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a79ac41b-83e9-4fa7-8fb0-eb1c65d11956 None None] MFA Rules not processed for user `24bf4c7eae174cbc93fa1bea22a79d89`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:57.605950 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a79ac41b-83e9-4fa7-8fb0-eb1c65d11956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:57.669243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1387/2738] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:57.673778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201effa-d35b-4bb0-8404-66cbccc6eeb1 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:57.737417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201effa-d35b-4bb0-8404-66cbccc6eeb1 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:57.741856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e066ab6-80f0-44fc-9257-e54dbda34087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:57.742482 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e066ab6-80f0-44fc-9257-e54dbda34087 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:57.742760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e066ab6-80f0-44fc-9257-e54dbda34087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:57.743032 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e066ab6-80f0-44fc-9257-e54dbda34087 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:57.743672 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e066ab6-80f0-44fc-9257-e54dbda34087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:57.746029 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e066ab6-80f0-44fc-9257-e54dbda34087 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:57.829246 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1352/2739] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:57 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:57.830713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ac41b-83e9-4fa7-8fb0-eb1c65d11956 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:57.842442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ac41b-83e9-4fa7-8fb0-eb1c65d11956 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:57.900527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d7c0d-af51-4db8-b436-ed0304d0a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:57.901529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7c0d-af51-4db8-b436-ed0304d0a593 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:57.901625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7c0d-af51-4db8-b436-ed0304d0a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:57.901897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7c0d-af51-4db8-b436-ed0304d0a593 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:57.902650 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d7c0d-af51-4db8-b436-ed0304d0a593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:57.904717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d7c0d-af51-4db8-b436-ed0304d0a593 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:58.071477 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1388/2740] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:57 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:58.075497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e066ab6-80f0-44fc-9257-e54dbda34087 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:58.085721 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e066ab6-80f0-44fc-9257-e54dbda34087 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:58.090178 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf9e75-0654-4c90-88a8-7cbe22a080bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:58.090797 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9e75-0654-4c90-88a8-7cbe22a080bf admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:58.091076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9e75-0654-4c90-88a8-7cbe22a080bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:58.091600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9e75-0654-4c90-88a8-7cbe22a080bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:58.092235 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf9e75-0654-4c90-88a8-7cbe22a080bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:58.093924 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf9e75-0654-4c90-88a8-7cbe22a080bf admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:58.104460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1353/2741] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:58.110118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d7c0d-af51-4db8-b436-ed0304d0a593 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:58.120841 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d7c0d-af51-4db8-b436-ed0304d0a593 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:58.125753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b5f3-e895-4247-a026-3c1b01c0b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:58.126528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b5f3-e895-4247-a026-3c1b01c0b2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:58.132315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b5f3-e895-4247-a026-3c1b01c0b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:58.132315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b5f3-e895-4247-a026-3c1b01c0b2b0 admin admin] PATH_INFO: `/v3/projects/d5370428778c4cfbb7e15b31bd239b15/users/6de7bb26a785406587d0162a9198c886/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:58.143408 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b5f3-e895-4247-a026-3c1b01c0b2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5370428778c4cfbb7e15b31bd239b15, user_id=6de7bb26a785406587d0162a9198c886, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:58.146295 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b5f3-e895-4247-a026-3c1b01c0b2b0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:58.225847 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1389/2742] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:58 2022] PUT /identity/v3/projects/d5370428778c4cfbb7e15b31bd239b15/users/6de7bb26a785406587d0162a9198c886/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:58.231031 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf9e75-0654-4c90-88a8-7cbe22a080bf admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:58.243171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf9e75-0654-4c90-88a8-7cbe22a080bf admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:58.265688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:58.319615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a35d8b-6559-4d94-a8b7-678874872dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:58.321754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a35d8b-6559-4d94-a8b7-678874872dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:58.321754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a35d8b-6559-4d94-a8b7-678874872dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:58.321754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a35d8b-6559-4d94-a8b7-678874872dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:58.321754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a35d8b-6559-4d94-a8b7-678874872dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:58.323358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a35d8b-6559-4d94-a8b7-678874872dd4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:58.334717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1354/2743] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:58.339993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b5f3-e895-4247-a026-3c1b01c0b2b0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:58.345886 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:58.351242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b5f3-e895-4247-a026-3c1b01c0b2b0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:58.356966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fdf6c-8ade-4861-a07f-e96ba6e18a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:58.357638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fdf6c-8ade-4861-a07f-e96ba6e18a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:58.357966 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fdf6c-8ade-4861-a07f-e96ba6e18a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:58.358286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fdf6c-8ade-4861-a07f-e96ba6e18a71 admin admin] PATH_INFO: `/v3/projects/d5370428778c4cfbb7e15b31bd239b15/users/6de7bb26a785406587d0162a9198c886/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:58.360201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fdf6c-8ade-4861-a07f-e96ba6e18a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5370428778c4cfbb7e15b31bd239b15, user_id=6de7bb26a785406587d0162a9198c886, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:58.362996 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fdf6c-8ade-4861-a07f-e96ba6e18a71 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:58.374442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1390/2744] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:58 2022] PUT /identity/v3/projects/d5370428778c4cfbb7e15b31bd239b15/users/6de7bb26a785406587d0162a9198c886/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:58.385975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0c091-fa76-4418-a8a9-948008250e3a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:58.386291 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0c091-fa76-4418-a8a9-948008250e3a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:58.386570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0c091-fa76-4418-a8a9-948008250e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:58.415245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-f3e0c091-fa76-4418-a8a9-948008250e3a None None] MFA Rules not processed for user `6de7bb26a785406587d0162a9198c886`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:58.416406 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f3e0c091-fa76-4418-a8a9-948008250e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:58.503527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1355/2745] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:58.520201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fdf6c-8ade-4861-a07f-e96ba6e18a71 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:58.520201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7e9fdf6c-8ade-4861-a07f-e96ba6e18a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:58.581492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fdf6c-8ade-4861-a07f-e96ba6e18a71 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:58.585493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d108e5-7de4-4cd4-b72e-3b2a659802dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:58.586119 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d108e5-7de4-4cd4-b72e-3b2a659802dc service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:58.586442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d108e5-7de4-4cd4-b72e-3b2a659802dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:58.586720 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d108e5-7de4-4cd4-b72e-3b2a659802dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:58.598638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d108e5-7de4-4cd4-b72e-3b2a659802dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:58.600101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d108e5-7de4-4cd4-b72e-3b2a659802dc service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:58.612021 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1391/2746] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:58.821527 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0c091-fa76-4418-a8a9-948008250e3a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:58.823914 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f3e0c091-fa76-4418-a8a9-948008250e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:58.841030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0c091-fa76-4418-a8a9-948008250e3a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:58.844032 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d108e5-7de4-4cd4-b72e-3b2a659802dc service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:58.845874 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875808-30c9-4857-a5b3-5ef9ecf5c573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:58.846039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-32d108e5-7de4-4cd4-b72e-3b2a659802dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:58.846557 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875808-30c9-4857-a5b3-5ef9ecf5c573 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:58.846838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875808-30c9-4857-a5b3-5ef9ecf5c573 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:58.847106 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875808-30c9-4857-a5b3-5ef9ecf5c573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:58.907577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33875808-30c9-4857-a5b3-5ef9ecf5c573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:58.909258 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33875808-30c9-4857-a5b3-5ef9ecf5c573 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:58.913103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d108e5-7de4-4cd4-b72e-3b2a659802dc service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:58.918997 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28947fa-62bb-4f01-91a0-c7a0181a9b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:58.924573 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1356/2747] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:58.924907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28947fa-62bb-4f01-91a0-c7a0181a9b1b service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:58.924907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28947fa-62bb-4f01-91a0-c7a0181a9b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:58.924907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28947fa-62bb-4f01-91a0-c7a0181a9b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:58.924907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c28947fa-62bb-4f01-91a0-c7a0181a9b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:58.974076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584897cf-f1d2-4939-9ae3-539d7a523cf5 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:58.974390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584897cf-f1d2-4939-9ae3-539d7a523cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:58.974664 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584897cf-f1d2-4939-9ae3-539d7a523cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:58.995632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28947fa-62bb-4f01-91a0-c7a0181a9b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:58.998531 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28947fa-62bb-4f01-91a0-c7a0181a9b1b service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:59.015187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1392/2748] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:54:59.016380 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-584897cf-f1d2-4939-9ae3-539d7a523cf5 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:59.022960 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-584897cf-f1d2-4939-9ae3-539d7a523cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:59.037808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1357/2749] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:59.088762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28947fa-62bb-4f01-91a0-c7a0181a9b1b service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:59.090990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c28947fa-62bb-4f01-91a0-c7a0181a9b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:59.147440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:59.180629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28947fa-62bb-4f01-91a0-c7a0181a9b1b service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:59.187739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c483f-288a-40d1-870a-abd6731f6758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:59.188370 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c483f-288a-40d1-870a-abd6731f6758 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:59.188657 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c483f-288a-40d1-870a-abd6731f6758 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:59.188938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c483f-288a-40d1-870a-abd6731f6758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:59.200840 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c483f-288a-40d1-870a-abd6731f6758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:59.202765 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c483f-288a-40d1-870a-abd6731f6758 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:59.219740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1393/2750] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:04.395785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68a064-8390-48b2-bc60-71747ba2f7c9 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:04.396261 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68a064-8390-48b2-bc60-71747ba2f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:04.396392 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68a064-8390-48b2-bc60-71747ba2f7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:04.423748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7d68a064-8390-48b2-bc60-71747ba2f7c9 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:04.424974 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7d68a064-8390-48b2-bc60-71747ba2f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:04.433163 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1358/2751] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:04.453652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c483f-288a-40d1-870a-abd6731f6758 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:04.455210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a06c483f-288a-40d1-870a-abd6731f6758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:04.473450 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c483f-288a-40d1-870a-abd6731f6758 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:04.480938 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b17312-f8ba-4367-aa3c-6b1374caa13f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:04.481690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17312-f8ba-4367-aa3c-6b1374caa13f service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:04.482047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17312-f8ba-4367-aa3c-6b1374caa13f service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:04.482369 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17312-f8ba-4367-aa3c-6b1374caa13f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:04.492969 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b17312-f8ba-4367-aa3c-6b1374caa13f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:04.495173 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b17312-f8ba-4367-aa3c-6b1374caa13f service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:04.507355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1394/2752] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:05.184628 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68a064-8390-48b2-bc60-71747ba2f7c9 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:05.196457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68a064-8390-48b2-bc60-71747ba2f7c9 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:05.201738 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:05.202522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:05.203090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:05.203469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] PATH_INFO: `/v3/users/24bf4c7eae174cbc93fa1bea22a79d89` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:05.204940 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24bf4c7eae174cbc93fa1bea22a79d89)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:05.207666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:05.357615 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:05.450075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24bf4c7eae174cbc93fa1bea22a79d89'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:05.479334 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24bf4c7eae174cbc93fa1bea22a79d89'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:05.563236 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24bf4c7eae174cbc93fa1bea22a79d89'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:05.574176 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24bf4c7eae174cbc93fa1bea22a79d89'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:05.574978 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24bf4c7eae174cbc93fa1bea22a79d89'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:05.582122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1359/2753] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:05 2022] DELETE /identity/v3/users/24bf4c7eae174cbc93fa1bea22a79d89 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:05.587732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e35e89-2e76-41a9-95b8-5a1e953f3bee None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:05.588883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e35e89-2e76-41a9-95b8-5a1e953f3bee None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:05.589315 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e35e89-2e76-41a9-95b8-5a1e953f3bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:05.614594 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e3e35e89-2e76-41a9-95b8-5a1e953f3bee None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:05.615814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e3e35e89-2e76-41a9-95b8-5a1e953f3bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:05.700009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1395/2754] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:05.712065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:05.712065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:05.774431 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce142c9-fb2e-4c45-b5a5-9ead11f04f70 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:05.778791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9728b-9b19-43a2-845c-ed07b28dfbfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:05.779401 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9728b-9b19-43a2-845c-ed07b28dfbfa service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:05.779681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9728b-9b19-43a2-845c-ed07b28dfbfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:05.779958 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9728b-9b19-43a2-845c-ed07b28dfbfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:05.789211 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9728b-9b19-43a2-845c-ed07b28dfbfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:05.790727 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9728b-9b19-43a2-845c-ed07b28dfbfa service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:05.800846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1360/2755] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:55:06.268284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e35e89-2e76-41a9-95b8-5a1e953f3bee None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:06.269851 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e3e35e89-2e76-41a9-95b8-5a1e953f3bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:06.282834 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e35e89-2e76-41a9-95b8-5a1e953f3bee None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:06.289850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:06.289850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:06.289850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:06.289850 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] PATH_INFO: `/v3/projects/1757333b615e49aa852242f2edd28db9` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:06.292438 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1757333b615e49aa852242f2edd28db9)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:06.294573 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:06.430382 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1757333b615e49aa852242f2edd28db9', 'request_id': 'req-d9413102-baf0-49bf-875a-9477905c56f5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:06.437468 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1757333b615e49aa852242f2edd28db9', 'request_id': 'req-d9413102-baf0-49bf-875a-9477905c56f5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:06.517565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1757333b615e49aa852242f2edd28db9', 'request_id': 'req-d9413102-baf0-49bf-875a-9477905c56f5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:06.527367 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] The token cache is being invalidate because project 1757333b615e49aa852242f2edd28db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:06.527727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:06.528361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:06.530225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1396/2756] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:06 2022] DELETE /identity/v3/projects/1757333b615e49aa852242f2edd28db9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:06.534389 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9728b-9b19-43a2-845c-ed07b28dfbfa service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:06.548281 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9728b-9b19-43a2-845c-ed07b28dfbfa service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:06.648240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:06.649122 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:06.650696 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:06.650696 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] PATH_INFO: `/v3/users/6de7bb26a785406587d0162a9198c886` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:06.651405 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de7bb26a785406587d0162a9198c886)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:06.653688 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:06.864998 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de7bb26a785406587d0162a9198c886'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:06.867148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:06.898448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de7bb26a785406587d0162a9198c886'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.021362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de7bb26a785406587d0162a9198c886'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.030975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de7bb26a785406587d0162a9198c886'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.037070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de7bb26a785406587d0162a9198c886'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.056148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1361/2757] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:06 2022] DELETE /identity/v3/users/6de7bb26a785406587d0162a9198c886 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:07.362532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:07.364303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:07.380028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9413102-baf0-49bf-875a-9477905c56f5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:07.422397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:07.445934 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:07.446537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:07.446825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:07.447102 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] PATH_INFO: `/v3/users/8ce7daea6fac45e79028cfd370bf0352` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:07.448270 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce7daea6fac45e79028cfd370bf0352)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:07.450200 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:07.484238 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:07.485821 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:07.499977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952836-c145-4702-ae38-65d966116e7d admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:07.506651 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:07.507496 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:07.507990 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:07.508472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] PATH_INFO: `/v3/projects/d5370428778c4cfbb7e15b31bd239b15` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:07.510184 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5370428778c4cfbb7e15b31bd239b15)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:07.512699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:07.660153 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5370428778c4cfbb7e15b31bd239b15', 'request_id': 'req-a4248c83-279a-4f6a-8654-09a08511be4d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.661733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce7daea6fac45e79028cfd370bf0352'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.662485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce7daea6fac45e79028cfd370bf0352'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.670133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce7daea6fac45e79028cfd370bf0352'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.682739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce7daea6fac45e79028cfd370bf0352'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.762069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5370428778c4cfbb7e15b31bd239b15', 'request_id': 'req-a4248c83-279a-4f6a-8654-09a08511be4d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.771894 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5370428778c4cfbb7e15b31bd239b15', 'request_id': 'req-a4248c83-279a-4f6a-8654-09a08511be4d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.780791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] The token cache is being invalidate because project d5370428778c4cfbb7e15b31bd239b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:07.781073 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.782337 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a4248c83-279a-4f6a-8654-09a08511be4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.783975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1362/2758] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:07 2022] DELETE /identity/v3/projects/d5370428778c4cfbb7e15b31bd239b15 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:07.788784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edb575-4369-4148-8ba8-ea1d10e71585 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:07.789065 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edb575-4369-4148-8ba8-ea1d10e71585 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:07.789493 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edb575-4369-4148-8ba8-ea1d10e71585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:07.811809 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-19edb575-4369-4148-8ba8-ea1d10e71585 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:07.812994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-19edb575-4369-4148-8ba8-ea1d10e71585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:07.870321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1363/2759] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:07.876324 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce7daea6fac45e79028cfd370bf0352'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:07.878157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d31c7a-b6b0-4fc1-b831-0382d9b91bcb None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:07.878479 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d31c7a-b6b0-4fc1-b831-0382d9b91bcb None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:07.878757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d31c7a-b6b0-4fc1-b831-0382d9b91bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:07.883931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1397/2760] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:07 2022] DELETE /identity/v3/users/8ce7daea6fac45e79028cfd370bf0352 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:07.899730 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-68d31c7a-b6b0-4fc1-b831-0382d9b91bcb None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:07.900901 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-68d31c7a-b6b0-4fc1-b831-0382d9b91bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:07.987306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1364/2761] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:07.991787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:07.993603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:08.020645 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:08.021286 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb296-fe3d-40a7-bf51-3e391881ab88 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:08.033208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b102985-4705-4bc0-98df-25bca73c872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:08.034000 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102985-4705-4bc0-98df-25bca73c872c admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:08.034389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102985-4705-4bc0-98df-25bca73c872c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:08.035308 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102985-4705-4bc0-98df-25bca73c872c admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:08.036030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b102985-4705-4bc0-98df-25bca73c872c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:55:08.036350 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b102985-4705-4bc0-98df-25bca73c872c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:08.038944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b102985-4705-4bc0-98df-25bca73c872c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:08.066563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1398/2762] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:55:08.067925 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d31c7a-b6b0-4fc1-b831-0382d9b91bcb None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:08.080195 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d31c7a-b6b0-4fc1-b831-0382d9b91bcb None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:08.091171 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70ec99-2267-4575-8eda-ae45cef5926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:08.092319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70ec99-2267-4575-8eda-ae45cef5926e admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:08.092879 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70ec99-2267-4575-8eda-ae45cef5926e admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:08.093429 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70ec99-2267-4575-8eda-ae45cef5926e admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:08.094457 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70ec99-2267-4575-8eda-ae45cef5926e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:08.099016 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70ec99-2267-4575-8eda-ae45cef5926e admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:08.159593 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b102985-4705-4bc0-98df-25bca73c872c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:08.161329 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1b102985-4705-4bc0-98df-25bca73c872c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:08.176274 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b102985-4705-4bc0-98df-25bca73c872c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:08.181686 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:08.192219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:08.192219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:08.192219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] PATH_INFO: `/v3/projects/8123121387be4bea8e4423da188443c1` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:08.192219 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8123121387be4bea8e4423da188443c1)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:08.193188 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1365/2763] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:55:08 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:55:08.193294 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:08.195194 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70ec99-2267-4575-8eda-ae45cef5926e admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:08.260705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70ec99-2267-4575-8eda-ae45cef5926e admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:08.266922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230c7ae-0c88-487f-bbf6-2c3f36c9a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:08.267477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230c7ae-0c88-487f-bbf6-2c3f36c9a088 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:08.267757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230c7ae-0c88-487f-bbf6-2c3f36c9a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:08.268207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230c7ae-0c88-487f-bbf6-2c3f36c9a088 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:08.268669 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230c7ae-0c88-487f-bbf6-2c3f36c9a088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:08.270652 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230c7ae-0c88-487f-bbf6-2c3f36c9a088 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:08.351822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8123121387be4bea8e4423da188443c1', 'request_id': 'req-92c58775-805a-4c27-902d-7a02e6d0feaa'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:08.359177 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8123121387be4bea8e4423da188443c1', 'request_id': 'req-92c58775-805a-4c27-902d-7a02e6d0feaa'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:08.405039 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1366/2764] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:55:08 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:55:08.407698 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230c7ae-0c88-487f-bbf6-2c3f36c9a088 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:08.422737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230c7ae-0c88-487f-bbf6-2c3f36c9a088 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:08.453673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8123121387be4bea8e4423da188443c1', 'request_id': 'req-92c58775-805a-4c27-902d-7a02e6d0feaa'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:08.471092 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] The token cache is being invalidate because project 8123121387be4bea8e4423da188443c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:08.471489 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:08.472464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:08.474735 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1399/2765] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:08 2022] DELETE /identity/v3/projects/8123121387be4bea8e4423da188443c1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:08.478944 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:08.480607 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:08.496430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f0182-b539-4745-bed9-5da28d27ca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:08.497142 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0182-b539-4745-bed9-5da28d27ca74 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:08.497499 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0182-b539-4745-bed9-5da28d27ca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:08.497843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0182-b539-4745-bed9-5da28d27ca74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:08.498590 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f0182-b539-4745-bed9-5da28d27ca74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:08.500311 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f0182-b539-4745-bed9-5da28d27ca74 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:08.514357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1367/2766] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:08.515634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f0182-b539-4745-bed9-5da28d27ca74 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:08.517324 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a96f0182-b539-4745-bed9-5da28d27ca74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:08.530626 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f0182-b539-4745-bed9-5da28d27ca74 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:08.535352 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6e980-7505-4eba-9b96-b663b63f35c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:08.535945 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6e980-7505-4eba-9b96-b663b63f35c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:08.536226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6e980-7505-4eba-9b96-b663b63f35c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:08.536503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6e980-7505-4eba-9b96-b663b63f35c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:08.537133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6e980-7505-4eba-9b96-b663b63f35c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:08.538773 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6e980-7505-4eba-9b96-b663b63f35c3 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:08.548188 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c58775-805a-4c27-902d-7a02e6d0feaa admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:08.554875 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1368/2767] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:55:08.555051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:08.555051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:08.555051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:08.555051 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] PATH_INFO: `/v3/users/54eb762868f749c3874b5af1b1001d78` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:08.561052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54eb762868f749c3874b5af1b1001d78)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:08.561052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:08.561839 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6e980-7505-4eba-9b96-b663b63f35c3 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:08.571854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6e980-7505-4eba-9b96-b663b63f35c3 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:08.578368 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a410f-4e77-4108-a231-2f31c71733ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:08.579206 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a410f-4e77-4108-a231-2f31c71733ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:08.579491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a410f-4e77-4108-a231-2f31c71733ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:08.579771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a410f-4e77-4108-a231-2f31c71733ab admin admin] PATH_INFO: `/v3/projects/fba32b5a3ef64352b69ba7980099e0e4/users/3d1c65cb839940e8ac3bb0baf97dce2d/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:08.585849 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:08.596480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a410f-4e77-4108-a231-2f31c71733ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba32b5a3ef64352b69ba7980099e0e4, user_id=3d1c65cb839940e8ac3bb0baf97dce2d, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:08.599231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a410f-4e77-4108-a231-2f31c71733ab admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:08.735024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1369/2768] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:08 2022] PUT /identity/v3/projects/fba32b5a3ef64352b69ba7980099e0e4/users/3d1c65cb839940e8ac3bb0baf97dce2d/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:08.746760 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e207ad-2c99-4eb1-b57a-9ac16b6ac81d None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:08.747055 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e207ad-2c99-4eb1-b57a-9ac16b6ac81d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:08.747329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e207ad-2c99-4eb1-b57a-9ac16b6ac81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:08.775149 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-33e207ad-2c99-4eb1-b57a-9ac16b6ac81d None None] MFA Rules not processed for user `3d1c65cb839940e8ac3bb0baf97dce2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:08.776296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-33e207ad-2c99-4eb1-b57a-9ac16b6ac81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:08.829085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54eb762868f749c3874b5af1b1001d78'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:08.829738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54eb762868f749c3874b5af1b1001d78'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:08.837164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54eb762868f749c3874b5af1b1001d78'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:08.843528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1370/2769] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:08.848172 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e207ad-2c99-4eb1-b57a-9ac16b6ac81d None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:08.850152 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54eb762868f749c3874b5af1b1001d78'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:08.910079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e207ad-2c99-4eb1-b57a-9ac16b6ac81d None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:08.914704 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf54570-3f69-4a71-b84f-8461bc2d267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:08.915307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54570-3f69-4a71-b84f-8461bc2d267c admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:08.915594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54570-3f69-4a71-b84f-8461bc2d267c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:08.915849 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54570-3f69-4a71-b84f-8461bc2d267c admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:08.916666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf54570-3f69-4a71-b84f-8461bc2d267c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:08.919898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf54570-3f69-4a71-b84f-8461bc2d267c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:08.922456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4e588613-5097-4e41-a6f3-c80bffb73856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54eb762868f749c3874b5af1b1001d78'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:08.930035 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1400/2770] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:08 2022] DELETE /identity/v3/users/54eb762868f749c3874b5af1b1001d78 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:09.028373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc277f0-f2ec-4e53-821b-2f01f0b6a630 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:09.028373 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc277f0-f2ec-4e53-821b-2f01f0b6a630 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:09.028605 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc277f0-f2ec-4e53-821b-2f01f0b6a630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:09.102883 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1371/2771] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:55:08 2022] POST /identity/v3/projects => generated 399 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:55:09.106141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf54570-3f69-4a71-b84f-8461bc2d267c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:09.113811 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-6bf54570-3f69-4a71-b84f-8461bc2d267c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:09.115545 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fdc277f0-f2ec-4e53-821b-2f01f0b6a630 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:09.116867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fdc277f0-f2ec-4e53-821b-2f01f0b6a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:09.231941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:09.259241 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1401/2772] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:09.263762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc277f0-f2ec-4e53-821b-2f01f0b6a630 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:09.263762 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fdc277f0-f2ec-4e53-821b-2f01f0b6a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:09.283039 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc277f0-f2ec-4e53-821b-2f01f0b6a630 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:09.292748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf54570-3f69-4a71-b84f-8461bc2d267c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:09.292942 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:09.293649 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:09.293916 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:09.294216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] PATH_INFO: `/v3/projects/689f7ecb54684a42bf2517f1d7b63a8d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:09.295410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=689f7ecb54684a42bf2517f1d7b63a8d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:09.297358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343fc29-ad66-4c2b-9a2f-5551cef42ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:09.297522 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:09.298218 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343fc29-ad66-4c2b-9a2f-5551cef42ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:09.298517 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343fc29-ad66-4c2b-9a2f-5551cef42ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:09.298784 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343fc29-ad66-4c2b-9a2f-5551cef42ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:09.299452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343fc29-ad66-4c2b-9a2f-5551cef42ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:09.303973 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343fc29-ad66-4c2b-9a2f-5551cef42ac7 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:09.420501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1372/2773] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:55:09 2022] POST /identity/v3/users => generated 306 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:55:09.424347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343fc29-ad66-4c2b-9a2f-5551cef42ac7 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:09.424347 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9343fc29-ad66-4c2b-9a2f-5551cef42ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:09.434250 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689f7ecb54684a42bf2517f1d7b63a8d', 'request_id': 'req-d223431a-0ac6-415a-816f-a847fb1542dc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:09.443529 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689f7ecb54684a42bf2517f1d7b63a8d', 'request_id': 'req-d223431a-0ac6-415a-816f-a847fb1542dc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:09.522030 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689f7ecb54684a42bf2517f1d7b63a8d', 'request_id': 'req-d223431a-0ac6-415a-816f-a847fb1542dc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:09.534147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] The token cache is being invalidate because project 689f7ecb54684a42bf2517f1d7b63a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:09.534386 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:09.535179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:09.536807 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1402/2774] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:09 2022] DELETE /identity/v3/projects/689f7ecb54684a42bf2517f1d7b63a8d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:09.537747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:09.539100 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:09.547970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343fc29-ad66-4c2b-9a2f-5551cef42ac7 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:09.607544 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223431a-0ac6-415a-816f-a847fb1542dc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:09.611896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c3ad3-c684-4c6b-b298-e4f7b496344a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:09.612519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c3ad3-c684-4c6b-b298-e4f7b496344a service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:09.612814 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c3ad3-c684-4c6b-b298-e4f7b496344a service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:09.613098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c3ad3-c684-4c6b-b298-e4f7b496344a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:09.614998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-981c3ad3-c684-4c6b-b298-e4f7b496344a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:09.626905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20916fac-bc2e-4903-9216-6fd698af7ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:09.627635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20916fac-bc2e-4903-9216-6fd698af7ec5 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:09.628011 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20916fac-bc2e-4903-9216-6fd698af7ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:09.628716 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20916fac-bc2e-4903-9216-6fd698af7ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:09.633975 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-20916fac-bc2e-4903-9216-6fd698af7ec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:09.701012 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c3ad3-c684-4c6b-b298-e4f7b496344a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:09.702823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c3ad3-c684-4c6b-b298-e4f7b496344a service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:09.714999 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1403/2775] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:09.717189 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c3ad3-c684-4c6b-b298-e4f7b496344a service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:09.720022 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-981c3ad3-c684-4c6b-b298-e4f7b496344a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:09.721666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20916fac-bc2e-4903-9216-6fd698af7ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:09.723397 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20916fac-bc2e-4903-9216-6fd698af7ec5 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:09.736503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1373/2776] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:09.742796 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c3ad3-c684-4c6b-b298-e4f7b496344a service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:09.753099 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fdd03-913f-41ca-8010-520c32399721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:09.753980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fdd03-913f-41ca-8010-520c32399721 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:09.754309 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fdd03-913f-41ca-8010-520c32399721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:09.754595 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fdd03-913f-41ca-8010-520c32399721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:09.756993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fdd03-913f-41ca-8010-520c32399721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:09.758925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fdd03-913f-41ca-8010-520c32399721 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:09.763990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:09.782029 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1404/2777] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:09.783351 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20916fac-bc2e-4903-9216-6fd698af7ec5 service nova] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:09.795969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20916fac-bc2e-4903-9216-6fd698af7ec5 service nova] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:09.801207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a786fc7-0e14-411c-a8bb-3e83bc2f3017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:09.802002 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786fc7-0e14-411c-a8bb-3e83bc2f3017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:09.802359 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786fc7-0e14-411c-a8bb-3e83bc2f3017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:09.802708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786fc7-0e14-411c-a8bb-3e83bc2f3017 admin admin] PATH_INFO: `/v3/projects/68445f4c586243dc8c7e196fd2883bc4/users/47db43ed78b0417ab15d7cfcfc29afbf/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:09.830023 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a786fc7-0e14-411c-a8bb-3e83bc2f3017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68445f4c586243dc8c7e196fd2883bc4, user_id=47db43ed78b0417ab15d7cfcfc29afbf, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:09.836234 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a786fc7-0e14-411c-a8bb-3e83bc2f3017 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:09.923329 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1374/2778] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:09 2022] PUT /identity/v3/projects/68445f4c586243dc8c7e196fd2883bc4/users/47db43ed78b0417ab15d7cfcfc29afbf/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:09.927504 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fdd03-913f-41ca-8010-520c32399721 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:09.939240 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fdd03-913f-41ca-8010-520c32399721 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:09.997763 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf1545-8b0e-4405-93ec-457ff1c2b2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:09.998440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf1545-8b0e-4405-93ec-457ff1c2b2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:09.998727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf1545-8b0e-4405-93ec-457ff1c2b2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:09.999009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf1545-8b0e-4405-93ec-457ff1c2b2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:09.999660 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf1545-8b0e-4405-93ec-457ff1c2b2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:10.001319 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf1545-8b0e-4405-93ec-457ff1c2b2b7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:10.014551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1405/2779] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:10.015812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a786fc7-0e14-411c-a8bb-3e83bc2f3017 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:10.024950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:10.028791 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a786fc7-0e14-411c-a8bb-3e83bc2f3017 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:10.033817 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70aa17d-6ed3-4c2b-be20-a9411a4995fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:10.034521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa17d-6ed3-4c2b-be20-a9411a4995fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:10.034907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa17d-6ed3-4c2b-be20-a9411a4995fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:10.035174 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa17d-6ed3-4c2b-be20-a9411a4995fc admin admin] PATH_INFO: `/v3/projects/68445f4c586243dc8c7e196fd2883bc4/users/47db43ed78b0417ab15d7cfcfc29afbf/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:10.037079 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70aa17d-6ed3-4c2b-be20-a9411a4995fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=68445f4c586243dc8c7e196fd2883bc4, user_id=47db43ed78b0417ab15d7cfcfc29afbf, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:10.039950 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70aa17d-6ed3-4c2b-be20-a9411a4995fc admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:10.051308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1375/2780] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:10 2022] PUT /identity/v3/projects/68445f4c586243dc8c7e196fd2883bc4/users/47db43ed78b0417ab15d7cfcfc29afbf/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:10.120079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a63dd-92e0-413c-b2ec-099ca5f8811f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:10.121167 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a63dd-92e0-413c-b2ec-099ca5f8811f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:10.121441 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a63dd-92e0-413c-b2ec-099ca5f8811f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:10.149689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fc5a63dd-92e0-413c-b2ec-099ca5f8811f None None] MFA Rules not processed for user `47db43ed78b0417ab15d7cfcfc29afbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:10.151036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fc5a63dd-92e0-413c-b2ec-099ca5f8811f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:10.224927 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1406/2781] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:10.237448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70aa17d-6ed3-4c2b-be20-a9411a4995fc admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:10.243404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d70aa17d-6ed3-4c2b-be20-a9411a4995fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:10.298091 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70aa17d-6ed3-4c2b-be20-a9411a4995fc admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:10.301648 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94403fdd-3bdd-469e-83ef-5e7177f9e0ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:10.302317 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94403fdd-3bdd-469e-83ef-5e7177f9e0ba service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:10.302599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94403fdd-3bdd-469e-83ef-5e7177f9e0ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:10.302896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94403fdd-3bdd-469e-83ef-5e7177f9e0ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:10.312675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94403fdd-3bdd-469e-83ef-5e7177f9e0ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:10.314094 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94403fdd-3bdd-469e-83ef-5e7177f9e0ba service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:10.324165 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1376/2782] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:10 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:10.572064 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a63dd-92e0-413c-b2ec-099ca5f8811f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:10.580390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:10.582673 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a63dd-92e0-413c-b2ec-099ca5f8811f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:10.586398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743699-bd34-405c-98af-ed9e833f1f45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:10.587017 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743699-bd34-405c-98af-ed9e833f1f45 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:10.587322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743699-bd34-405c-98af-ed9e833f1f45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:10.592140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743699-bd34-405c-98af-ed9e833f1f45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:10.592140 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-44743699-bd34-405c-98af-ed9e833f1f45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:10.620178 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:10.653493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44743699-bd34-405c-98af-ed9e833f1f45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:10.654955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44743699-bd34-405c-98af-ed9e833f1f45 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:10.664146 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1407/2783] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:13.806887 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7e58f-e7c7-4e6a-afcc-0300dc66edee None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:13.807425 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7e58f-e7c7-4e6a-afcc-0300dc66edee None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:13.807425 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7e58f-e7c7-4e6a-afcc-0300dc66edee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:13.830582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-0cc7e58f-e7c7-4e6a-afcc-0300dc66edee None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:13.831867 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0cc7e58f-e7c7-4e6a-afcc-0300dc66edee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:13.894833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1377/2784] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:13.926326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743699-bd34-405c-98af-ed9e833f1f45 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:13.927861 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-44743699-bd34-405c-98af-ed9e833f1f45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:13.934630 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:14.009685 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743699-bd34-405c-98af-ed9e833f1f45 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:14.015853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33351fc-dd4e-4c32-9053-74026731df21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:14.021010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33351fc-dd4e-4c32-9053-74026731df21 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:14.021010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33351fc-dd4e-4c32-9053-74026731df21 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:14.021010 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33351fc-dd4e-4c32-9053-74026731df21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:14.025611 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33351fc-dd4e-4c32-9053-74026731df21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:14.028297 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33351fc-dd4e-4c32-9053-74026731df21 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:14.042794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1408/2785] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:17.055444 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee9ae3-6b13-49b2-b63f-5b6e244a22e3 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:17.056027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee9ae3-6b13-49b2-b63f-5b6e244a22e3 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:17.056027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee9ae3-6b13-49b2-b63f-5b6e244a22e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:17.076182 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-c3ee9ae3-6b13-49b2-b63f-5b6e244a22e3 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:17.077394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c3ee9ae3-6b13-49b2-b63f-5b6e244a22e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:17.085812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1378/2786] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:17.108780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33351fc-dd4e-4c32-9053-74026731df21 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:17.110649 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e33351fc-dd4e-4c32-9053-74026731df21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:17.122745 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee9ae3-6b13-49b2-b63f-5b6e244a22e3 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:17.126592 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33351fc-dd4e-4c32-9053-74026731df21 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:17.132225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a0c7e-a346-4e43-b134-ef70fde58638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:17.132597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee9ae3-6b13-49b2-b63f-5b6e244a22e3 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:17.132833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0c7e-a346-4e43-b134-ef70fde58638 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:17.133118 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0c7e-a346-4e43-b134-ef70fde58638 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:17.133413 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0c7e-a346-4e43-b134-ef70fde58638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:17.137327 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:17.137989 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:17.138300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:17.138577 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] PATH_INFO: `/v3/users/3d1c65cb839940e8ac3bb0baf97dce2d` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:17.139735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d1c65cb839940e8ac3bb0baf97dce2d)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:17.141663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:17.141978 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a0c7e-a346-4e43-b134-ef70fde58638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:17.143676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a0c7e-a346-4e43-b134-ef70fde58638 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:17.144090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:17.154528 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1409/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:17.297292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d1c65cb839940e8ac3bb0baf97dce2d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:17.310069 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d1c65cb839940e8ac3bb0baf97dce2d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:17.384812 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d1c65cb839940e8ac3bb0baf97dce2d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:17.393702 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d1c65cb839940e8ac3bb0baf97dce2d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:17.394417 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d1c65cb839940e8ac3bb0baf97dce2d'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:17.404524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1379/2788] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:17 2022] DELETE /identity/v3/users/3d1c65cb839940e8ac3bb0baf97dce2d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:17.406425 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d158930-ed15-4430-a337-e324e9cbe04e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:17.406719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d158930-ed15-4430-a337-e324e9cbe04e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:17.407004 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d158930-ed15-4430-a337-e324e9cbe04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:17.425995 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5d158930-ed15-4430-a337-e324e9cbe04e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:17.427243 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5d158930-ed15-4430-a337-e324e9cbe04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:17.489389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1410/2789] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:17.500369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:17.501907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:17.561647 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac979a-9108-4407-a80d-3c15be3013ae admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:17.565226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7b37b-5bce-4e2c-a55f-643a9c9b5ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:17.565855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7b37b-5bce-4e2c-a55f-643a9c9b5ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:17.566131 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7b37b-5bce-4e2c-a55f-643a9c9b5ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:17.566432 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7b37b-5bce-4e2c-a55f-643a9c9b5ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:17.575922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7b37b-5bce-4e2c-a55f-643a9c9b5ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:17.577334 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7b37b-5bce-4e2c-a55f-643a9c9b5ce0 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:17.588997 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1380/2790] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:17.620242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d158930-ed15-4430-a337-e324e9cbe04e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:17.621913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5d158930-ed15-4430-a337-e324e9cbe04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:17.635917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d158930-ed15-4430-a337-e324e9cbe04e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:17.641439 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:17.642082 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:17.642433 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:17.642715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] PATH_INFO: `/v3/users/7e201fc6021b4e788af5441a2ffb0777` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:17.643973 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e201fc6021b4e788af5441a2ffb0777)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:17.650965 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:17.919397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e201fc6021b4e788af5441a2ffb0777'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:17.920156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e201fc6021b4e788af5441a2ffb0777'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:17.927147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e201fc6021b4e788af5441a2ffb0777'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:17.938403 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:17.939766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e201fc6021b4e788af5441a2ffb0777'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.019040 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e201fc6021b4e788af5441a2ffb0777'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.025569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1411/2791] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:17 2022] DELETE /identity/v3/users/7e201fc6021b4e788af5441a2ffb0777 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:18.055587 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7b37b-5bce-4e2c-a55f-643a9c9b5ce0 service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:18.057625 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5ae7b37b-5bce-4e2c-a55f-643a9c9b5ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:18.072689 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7b37b-5bce-4e2c-a55f-643a9c9b5ce0 service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:18.134565 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:18.135223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:18.135512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:18.136957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] PATH_INFO: `/v3/projects/fba32b5a3ef64352b69ba7980099e0e4` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:18.138357 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba32b5a3ef64352b69ba7980099e0e4)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:18.140307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:18.272164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:18.277775 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:18.279260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:18.290125 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba32b5a3ef64352b69ba7980099e0e4', 'request_id': 'req-70bed8bf-8fac-418d-9b34-4199251503fb'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.294464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb82fec-0f20-4cbf-a12c-09897231ac84 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:18.339138 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba32b5a3ef64352b69ba7980099e0e4', 'request_id': 'req-70bed8bf-8fac-418d-9b34-4199251503fb'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.346395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba32b5a3ef64352b69ba7980099e0e4', 'request_id': 'req-70bed8bf-8fac-418d-9b34-4199251503fb'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.356456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:18.357101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:18.357751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:18.357751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] PATH_INFO: `/v3/projects/6c4d2e4a81f24d8e980bf2d7e845643b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:18.358799 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4d2e4a81f24d8e980bf2d7e845643b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:18.360256 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] The token cache is being invalidate because project fba32b5a3ef64352b69ba7980099e0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:18.360673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.360794 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:18.361300 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.362810 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1381/2792] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:18 2022] DELETE /identity/v3/projects/fba32b5a3ef64352b69ba7980099e0e4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:18.366675 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:18.368491 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:18.382084 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bed8bf-8fac-418d-9b34-4199251503fb admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:18.387684 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:18.388306 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:18.388586 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:18.388858 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] PATH_INFO: `/v3/users/47db43ed78b0417ab15d7cfcfc29afbf` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:18.389971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=47db43ed78b0417ab15d7cfcfc29afbf)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:18.391910 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:18.448169 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4d2e4a81f24d8e980bf2d7e845643b', 'request_id': 'req-fa983fcf-1f3d-48e1-953a-fddb151c520b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.454457 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4d2e4a81f24d8e980bf2d7e845643b', 'request_id': 'req-fa983fcf-1f3d-48e1-953a-fddb151c520b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.556464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4d2e4a81f24d8e980bf2d7e845643b', 'request_id': 'req-fa983fcf-1f3d-48e1-953a-fddb151c520b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.568448 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] The token cache is being invalidate because project 6c4d2e4a81f24d8e980bf2d7e845643b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:18.568745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.569389 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.571090 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1412/2793] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:18 2022] DELETE /identity/v3/projects/6c4d2e4a81f24d8e980bf2d7e845643b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:18.575159 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:18.576456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:18.639216 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa983fcf-1f3d-48e1-953a-fddb151c520b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:18.643853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:18.645269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:18.645269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:18.645269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] PATH_INFO: `/v3/users/173de8c4b5a04eb5906d9fc7360e16d6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:18.646292 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173de8c4b5a04eb5906d9fc7360e16d6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:18.648229 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:18.657448 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47db43ed78b0417ab15d7cfcfc29afbf'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.670953 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47db43ed78b0417ab15d7cfcfc29afbf'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.672287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:18.750612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47db43ed78b0417ab15d7cfcfc29afbf'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.758545 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47db43ed78b0417ab15d7cfcfc29afbf'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.759231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47db43ed78b0417ab15d7cfcfc29afbf'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.765458 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1382/2794] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:18 2022] DELETE /identity/v3/users/47db43ed78b0417ab15d7cfcfc29afbf => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:18.833694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173de8c4b5a04eb5906d9fc7360e16d6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.834404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173de8c4b5a04eb5906d9fc7360e16d6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.843835 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173de8c4b5a04eb5906d9fc7360e16d6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.856621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173de8c4b5a04eb5906d9fc7360e16d6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.921800 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173de8c4b5a04eb5906d9fc7360e16d6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:18.928210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1413/2795] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:18 2022] DELETE /identity/v3/users/173de8c4b5a04eb5906d9fc7360e16d6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:19.159447 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:19.161215 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:19.244753 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:19.245632 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:19.254485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4165358-a471-4a3d-b637-3b9a87e9cedb admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:19.294124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:19.320548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:19.321209 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.321484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.321750 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] PATH_INFO: `/v3/projects/68445f4c586243dc8c7e196fd2883bc4` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.321883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce5dc7-56ef-424e-a17c-f08b217c6d77 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:19.322881 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68445f4c586243dc8c7e196fd2883bc4)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:19.324917 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:19.326719 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:19.327353 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.327637 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.327911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] PATH_INFO: `/v3/projects/8032e0380e6143f785074f693ea2e22f` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.329028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8032e0380e6143f785074f693ea2e22f)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:19.331325 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:19.437668 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68445f4c586243dc8c7e196fd2883bc4', 'request_id': 'req-a810d633-cc68-4b9c-af09-ae204fa1f724'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:19.438816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8032e0380e6143f785074f693ea2e22f', 'request_id': 'req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:19.445141 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8032e0380e6143f785074f693ea2e22f', 'request_id': 'req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:19.539475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68445f4c586243dc8c7e196fd2883bc4', 'request_id': 'req-a810d633-cc68-4b9c-af09-ae204fa1f724'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:19.546852 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68445f4c586243dc8c7e196fd2883bc4', 'request_id': 'req-a810d633-cc68-4b9c-af09-ae204fa1f724'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:19.557927 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] The token cache is being invalidate because project 68445f4c586243dc8c7e196fd2883bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:19.558701 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:19.559335 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a810d633-cc68-4b9c-af09-ae204fa1f724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:19.560850 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1383/2796] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:19 2022] DELETE /identity/v3/projects/68445f4c586243dc8c7e196fd2883bc4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:19.565608 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb118f-47fc-4eec-a114-e3084578bac2 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.565965 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb118f-47fc-4eec-a114-e3084578bac2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.566297 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb118f-47fc-4eec-a114-e3084578bac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.585591 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-22fb118f-47fc-4eec-a114-e3084578bac2 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:19.586816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-22fb118f-47fc-4eec-a114-e3084578bac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:19.613629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8032e0380e6143f785074f693ea2e22f', 'request_id': 'req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:19.625816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] The token cache is being invalidate because project 8032e0380e6143f785074f693ea2e22f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:19.626114 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:19.626784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d70977a3-e616-49ef-bbc0-a6b25d1d4e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:19.628280 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1414/2797] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:19 2022] DELETE /identity/v3/projects/8032e0380e6143f785074f693ea2e22f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:19.634109 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5dea0-1621-4887-b112-986ebb31b896 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.634456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5dea0-1621-4887-b112-986ebb31b896 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.634743 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5dea0-1621-4887-b112-986ebb31b896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.649681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1384/2798] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:19.657647 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-98b5dea0-1621-4887-b112-986ebb31b896 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:19.658051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd187fd-be4a-4a1f-a419-97c2e7f9b36d None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.658378 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd187fd-be4a-4a1f-a419-97c2e7f9b36d None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.658660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd187fd-be4a-4a1f-a419-97c2e7f9b36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.658904 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-98b5dea0-1621-4887-b112-986ebb31b896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:19.667211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1415/2799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:19.676161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476adb93-d174-463b-b552-055aebf4f8ce None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.676472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476adb93-d174-463b-b552-055aebf4f8ce None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.676752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476adb93-d174-463b-b552-055aebf4f8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.679696 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-0fd187fd-be4a-4a1f-a419-97c2e7f9b36d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:19.680964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0fd187fd-be4a-4a1f-a419-97c2e7f9b36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:19.689561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1385/2800] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:19.693627 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd187fd-be4a-4a1f-a419-97c2e7f9b36d None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:19.696998 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-476adb93-d174-463b-b552-055aebf4f8ce None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:19.698281 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-476adb93-d174-463b-b552-055aebf4f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:19.702999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd187fd-be4a-4a1f-a419-97c2e7f9b36d None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:19.706121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1416/2801] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:19.707594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec1d34-727c-445e-8b61-527beb8681c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:19.708224 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec1d34-727c-445e-8b61-527beb8681c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.708490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec1d34-727c-445e-8b61-527beb8681c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.708766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec1d34-727c-445e-8b61-527beb8681c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.709430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec1d34-727c-445e-8b61-527beb8681c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:55:19.709737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec1d34-727c-445e-8b61-527beb8681c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:19.710326 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476adb93-d174-463b-b552-055aebf4f8ce None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:19.711363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec1d34-727c-445e-8b61-527beb8681c4 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:19.719955 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476adb93-d174-463b-b552-055aebf4f8ce None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:19.723666 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1386/2802] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:55:19.724744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66aad6-ba60-49ba-ad0d-2e4b2868f2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:19.725341 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66aad6-ba60-49ba-ad0d-2e4b2868f2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.725664 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66aad6-ba60-49ba-ad0d-2e4b2868f2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.725931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66aad6-ba60-49ba-ad0d-2e4b2868f2e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.726602 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66aad6-ba60-49ba-ad0d-2e4b2868f2e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:55:19.726907 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66aad6-ba60-49ba-ad0d-2e4b2868f2e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:19.727988 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec1d34-727c-445e-8b61-527beb8681c4 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:19.728559 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66aad6-ba60-49ba-ad0d-2e4b2868f2e4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:19.738388 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec1d34-727c-445e-8b61-527beb8681c4 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:19.745121 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1417/2803] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:55:19.746985 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66aad6-ba60-49ba-ad0d-2e4b2868f2e4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:19.747376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9b458-9925-46b6-be0c-e864f5674889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:19.747985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9b458-9925-46b6-be0c-e864f5674889 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.748286 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9b458-9925-46b6-be0c-e864f5674889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.748570 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9b458-9925-46b6-be0c-e864f5674889 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.749223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9b458-9925-46b6-be0c-e864f5674889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:19.751156 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9b458-9925-46b6-be0c-e864f5674889 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:19.752075 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:19.756992 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66aad6-ba60-49ba-ad0d-2e4b2868f2e4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:19.762549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9131e-5f7d-41a9-9414-70d42589dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:19.763503 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9131e-5f7d-41a9-9414-70d42589dff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.763503 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9131e-5f7d-41a9-9414-70d42589dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.768089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9131e-5f7d-41a9-9414-70d42589dff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.768089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9131e-5f7d-41a9-9414-70d42589dff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:19.768089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9131e-5f7d-41a9-9414-70d42589dff8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:19.837299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1387/2804] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:55:19 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:55:19.841621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9b458-9925-46b6-be0c-e864f5674889 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:19.866793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1418/2805] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:55:19 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:55:19.866989 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:19.868244 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9131e-5f7d-41a9-9414-70d42589dff8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:19.904290 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9b458-9925-46b6-be0c-e864f5674889 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:19.930773 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9131e-5f7d-41a9-9414-70d42589dff8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:19.936577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3519d2e-a253-4bd2-90b8-ed8fb81c6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:19.937183 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3519d2e-a253-4bd2-90b8-ed8fb81c6c45 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.937463 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3519d2e-a253-4bd2-90b8-ed8fb81c6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.937784 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3519d2e-a253-4bd2-90b8-ed8fb81c6c45 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.938690 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3519d2e-a253-4bd2-90b8-ed8fb81c6c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:19.941320 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3519d2e-a253-4bd2-90b8-ed8fb81c6c45 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:19.960119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8b782-4489-497d-b7e2-b2b4532515ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:19.960745 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8b782-4489-497d-b7e2-b2b4532515ae admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:19.961213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8b782-4489-497d-b7e2-b2b4532515ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:19.961542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8b782-4489-497d-b7e2-b2b4532515ae admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:19.962794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8b782-4489-497d-b7e2-b2b4532515ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:19.965395 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8b782-4489-497d-b7e2-b2b4532515ae admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:19.996148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1419/2806] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:55:19 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:55:20.000383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3519d2e-a253-4bd2-90b8-ed8fb81c6c45 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.009631 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3519d2e-a253-4bd2-90b8-ed8fb81c6c45 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.014296 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42ea93-281a-4ef3-9a7c-eb09b8987bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.014986 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42ea93-281a-4ef3-9a7c-eb09b8987bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.015278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42ea93-281a-4ef3-9a7c-eb09b8987bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.015556 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42ea93-281a-4ef3-9a7c-eb09b8987bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.016187 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42ea93-281a-4ef3-9a7c-eb09b8987bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.017830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42ea93-281a-4ef3-9a7c-eb09b8987bf6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.028770 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1420/2807] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:55:20.032681 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42ea93-281a-4ef3-9a7c-eb09b8987bf6 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.042049 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42ea93-281a-4ef3-9a7c-eb09b8987bf6 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.047355 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb39404-0a8f-4bf3-9b2b-f68225d1e209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.047918 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb39404-0a8f-4bf3-9b2b-f68225d1e209 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.048201 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb39404-0a8f-4bf3-9b2b-f68225d1e209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.048473 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb39404-0a8f-4bf3-9b2b-f68225d1e209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.049084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb39404-0a8f-4bf3-9b2b-f68225d1e209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.050659 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb39404-0a8f-4bf3-9b2b-f68225d1e209 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.063051 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1388/2808] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:55:19 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:55:20.063230 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1421/2809] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:55:20.065367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8b782-4489-497d-b7e2-b2b4532515ae admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.065519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb39404-0a8f-4bf3-9b2b-f68225d1e209 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.076426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb39404-0a8f-4bf3-9b2b-f68225d1e209 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.076559 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8b782-4489-497d-b7e2-b2b4532515ae admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.081501 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44cf3b-7fcf-4965-828e-4e51b73032fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.082105 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44cf3b-7fcf-4965-828e-4e51b73032fe admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.082418 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44cf3b-7fcf-4965-828e-4e51b73032fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.082691 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44cf3b-7fcf-4965-828e-4e51b73032fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.083356 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44cf3b-7fcf-4965-828e-4e51b73032fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.084984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44cf3b-7fcf-4965-828e-4e51b73032fe admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.085265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1a48-739b-4b57-a2b6-2166b5e2b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.086226 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1a48-739b-4b57-a2b6-2166b5e2b486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.086768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1a48-739b-4b57-a2b6-2166b5e2b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.087047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1a48-739b-4b57-a2b6-2166b5e2b486 admin admin] PATH_INFO: `/v3/projects/7019df6753974221810ffffd45b4ba4a/users/191db14d35aa46b9a70c0ac66fc3fe1c/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.097780 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1389/2810] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:20.101578 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44cf3b-7fcf-4965-828e-4e51b73032fe admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.106739 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1a48-739b-4b57-a2b6-2166b5e2b486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7019df6753974221810ffffd45b4ba4a, user_id=191db14d35aa46b9a70c0ac66fc3fe1c, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.109534 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1a48-739b-4b57-a2b6-2166b5e2b486 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.112720 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44cf3b-7fcf-4965-828e-4e51b73032fe admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.117367 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cbc9e-7b40-4a8d-87aa-06303fda7193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.117947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cbc9e-7b40-4a8d-87aa-06303fda7193 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.118251 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cbc9e-7b40-4a8d-87aa-06303fda7193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.118543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cbc9e-7b40-4a8d-87aa-06303fda7193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.119148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cbc9e-7b40-4a8d-87aa-06303fda7193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.120838 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cbc9e-7b40-4a8d-87aa-06303fda7193 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.131358 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1390/2811] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:55:20.137856 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cbc9e-7b40-4a8d-87aa-06303fda7193 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.147289 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cbc9e-7b40-4a8d-87aa-06303fda7193 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.152308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aa2fe-65c3-4ccf-bd1f-9aad63d7cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.153219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aa2fe-65c3-4ccf-bd1f-9aad63d7cfc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.153500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aa2fe-65c3-4ccf-bd1f-9aad63d7cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.153775 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aa2fe-65c3-4ccf-bd1f-9aad63d7cfc9 admin admin] PATH_INFO: `/v3/projects/edacdddc1d74476b8f9dbcc0ae804059/users/23589464135a411295c36546407f241e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.168470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aa2fe-65c3-4ccf-bd1f-9aad63d7cfc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edacdddc1d74476b8f9dbcc0ae804059, user_id=23589464135a411295c36546407f241e, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.171737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aa2fe-65c3-4ccf-bd1f-9aad63d7cfc9 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.276689 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1422/2812] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:20 2022] PUT /identity/v3/projects/7019df6753974221810ffffd45b4ba4a/users/191db14d35aa46b9a70c0ac66fc3fe1c/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:20.287468 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff631-ded2-4d60-a82b-8bf9a0830e43 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.287759 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff631-ded2-4d60-a82b-8bf9a0830e43 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.288036 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff631-ded2-4d60-a82b-8bf9a0830e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.305252 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1391/2813] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:20 2022] PUT /identity/v3/projects/edacdddc1d74476b8f9dbcc0ae804059/users/23589464135a411295c36546407f241e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:20.315575 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eb499-5032-4717-9476-e02133da6beb None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.315857 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eb499-5032-4717-9476-e02133da6beb None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.316124 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eb499-5032-4717-9476-e02133da6beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.316925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-152ff631-ded2-4d60-a82b-8bf9a0830e43 None None] MFA Rules not processed for user `191db14d35aa46b9a70c0ac66fc3fe1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:20.318142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-152ff631-ded2-4d60-a82b-8bf9a0830e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:20.344861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-be0eb499-5032-4717-9476-e02133da6beb None None] MFA Rules not processed for user `23589464135a411295c36546407f241e`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:20.346077 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-be0eb499-5032-4717-9476-e02133da6beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:20.385669 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1423/2814] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:20.397179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ff631-ded2-4d60-a82b-8bf9a0830e43 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.398776 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-152ff631-ded2-4d60-a82b-8bf9a0830e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:20.413422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:20.415192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1392/2815] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:20.419681 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eb499-5032-4717-9476-e02133da6beb None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.423794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:20.455826 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ff631-ded2-4d60-a82b-8bf9a0830e43 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.459481 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed4133-e806-4c76-b9d9-f9abe72c296e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.460089 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed4133-e806-4c76-b9d9-f9abe72c296e service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.461654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed4133-e806-4c76-b9d9-f9abe72c296e service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.461654 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed4133-e806-4c76-b9d9-f9abe72c296e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.469844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed4133-e806-4c76-b9d9-f9abe72c296e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.471314 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed4133-e806-4c76-b9d9-f9abe72c296e service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.480054 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1424/2816] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:55:20.483843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eb499-5032-4717-9476-e02133da6beb None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.491703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8abb3e-f325-4d74-bb04-a2b1a9d7d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.491703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8abb3e-f325-4d74-bb04-a2b1a9d7d586 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.491703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8abb3e-f325-4d74-bb04-a2b1a9d7d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.491703 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8abb3e-f325-4d74-bb04-a2b1a9d7d586 admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.492118 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8abb3e-f325-4d74-bb04-a2b1a9d7d586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.492941 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8abb3e-f325-4d74-bb04-a2b1a9d7d586 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.621520 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1393/2817] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:55:20 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:55:20.625561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed4133-e806-4c76-b9d9-f9abe72c296e service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.635883 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed4133-e806-4c76-b9d9-f9abe72c296e service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.693209 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1620c99-0b11-4b40-9663-0a7ebf684ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.693856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1620c99-0b11-4b40-9663-0a7ebf684ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.694138 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1620c99-0b11-4b40-9663-0a7ebf684ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.694445 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1620c99-0b11-4b40-9663-0a7ebf684ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.695078 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1620c99-0b11-4b40-9663-0a7ebf684ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.697024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1620c99-0b11-4b40-9663-0a7ebf684ce1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.842485 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1425/2818] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:55:20 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:55:20.846428 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8abb3e-f325-4d74-bb04-a2b1a9d7d586 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.857705 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8abb3e-f325-4d74-bb04-a2b1a9d7d586 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.862325 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36885fd6-1293-45fa-8c5e-359d039b5ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.862952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885fd6-1293-45fa-8c5e-359d039b5ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.863296 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885fd6-1293-45fa-8c5e-359d039b5ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.863604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885fd6-1293-45fa-8c5e-359d039b5ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.864247 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36885fd6-1293-45fa-8c5e-359d039b5ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.866127 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36885fd6-1293-45fa-8c5e-359d039b5ef8 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.880679 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1394/2819] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:20.884720 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1620c99-0b11-4b40-9663-0a7ebf684ce1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.895643 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1620c99-0b11-4b40-9663-0a7ebf684ce1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.900210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71316025-78b8-47c1-bbf6-761cc90471c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.900844 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71316025-78b8-47c1-bbf6-761cc90471c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.901127 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71316025-78b8-47c1-bbf6-761cc90471c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.901418 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71316025-78b8-47c1-bbf6-761cc90471c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.902253 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71316025-78b8-47c1-bbf6-761cc90471c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.904287 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71316025-78b8-47c1-bbf6-761cc90471c4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:20.913694 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1426/2820] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:20.918162 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36885fd6-1293-45fa-8c5e-359d039b5ef8 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:20.928213 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36885fd6-1293-45fa-8c5e-359d039b5ef8 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:20.932635 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a31e6-e37c-4969-ba00-d9f40501289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:20.933813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a31e6-e37c-4969-ba00-d9f40501289a admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:20.934372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a31e6-e37c-4969-ba00-d9f40501289a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:20.934680 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a31e6-e37c-4969-ba00-d9f40501289a admin admin] PATH_INFO: `/v3/projects/e2e4782fff4c4bbca587af2dcbec198c/users/7484b9dc92b9473a935331e7c714839e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:20.949618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a31e6-e37c-4969-ba00-d9f40501289a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e4782fff4c4bbca587af2dcbec198c, user_id=7484b9dc92b9473a935331e7c714839e, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:20.952502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a31e6-e37c-4969-ba00-d9f40501289a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:21.014462 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1395/2821] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:20 2022] PUT /identity/v3/projects/e2e4782fff4c4bbca587af2dcbec198c/users/7484b9dc92b9473a935331e7c714839e/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:21.025803 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a281e-4f0e-4e0d-9990-ae5638c874b9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:21.026091 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a281e-4f0e-4e0d-9990-ae5638c874b9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:21.026398 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a281e-4f0e-4e0d-9990-ae5638c874b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:21.053454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e46a281e-4f0e-4e0d-9990-ae5638c874b9 None None] MFA Rules not processed for user `7484b9dc92b9473a935331e7c714839e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:21.054737 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e46a281e-4f0e-4e0d-9990-ae5638c874b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:21.125894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1427/2822] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:21.130081 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a31e6-e37c-4969-ba00-d9f40501289a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:21.214435 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a31e6-e37c-4969-ba00-d9f40501289a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:21.219409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40a732-8424-4568-a4d0-102f78aef08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:21.220012 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a732-8424-4568-a4d0-102f78aef08b admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:21.220298 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a732-8424-4568-a4d0-102f78aef08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:21.220598 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a732-8424-4568-a4d0-102f78aef08b admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:21.226770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40a732-8424-4568-a4d0-102f78aef08b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:21.226770 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40a732-8424-4568-a4d0-102f78aef08b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:21.318808 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1396/2823] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:55:21 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:55:21.331860 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a281e-4f0e-4e0d-9990-ae5638c874b9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:21.342839 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a281e-4f0e-4e0d-9990-ae5638c874b9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:21.363960 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:21.371503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f70c2-7d78-4d5a-8f12-8bfdc4b97350 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:21.371918 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f70c2-7d78-4d5a-8f12-8bfdc4b97350 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:21.372203 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f70c2-7d78-4d5a-8f12-8bfdc4b97350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:21.397508 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-d30f70c2-7d78-4d5a-8f12-8bfdc4b97350 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:21.398736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d30f70c2-7d78-4d5a-8f12-8bfdc4b97350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:21.405018 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6345b-7b40-4c29-bd1c-623beaa9388e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:21.405634 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6345b-7b40-4c29-bd1c-623beaa9388e admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:21.406165 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6345b-7b40-4c29-bd1c-623beaa9388e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:21.406766 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6345b-7b40-4c29-bd1c-623beaa9388e admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:21.407751 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6345b-7b40-4c29-bd1c-623beaa9388e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:21.409793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6345b-7b40-4c29-bd1c-623beaa9388e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:21.439120 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:21.469568 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1397/2824] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:21.493779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f70c2-7d78-4d5a-8f12-8bfdc4b97350 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:21.495185 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-d30f70c2-7d78-4d5a-8f12-8bfdc4b97350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:21.507961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1428/2825] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:55:21 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:55:21.509106 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6345b-7b40-4c29-bd1c-623beaa9388e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:21.519322 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6345b-7b40-4c29-bd1c-623beaa9388e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:21.524211 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf08911-97d3-4758-8df5-51f3a14010fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:21.524808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf08911-97d3-4758-8df5-51f3a14010fa admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:21.525094 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf08911-97d3-4758-8df5-51f3a14010fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:21.525380 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf08911-97d3-4758-8df5-51f3a14010fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:21.526023 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf08911-97d3-4758-8df5-51f3a14010fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:21.528636 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf08911-97d3-4758-8df5-51f3a14010fa admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:21.538842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1429/2826] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:21.543812 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf08911-97d3-4758-8df5-51f3a14010fa admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:21.553715 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf08911-97d3-4758-8df5-51f3a14010fa admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:21.558813 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b45fba-2067-4f31-81c0-4ba7034c3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:21.559466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45fba-2067-4f31-81c0-4ba7034c3ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:21.559867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45fba-2067-4f31-81c0-4ba7034c3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:21.560348 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45fba-2067-4f31-81c0-4ba7034c3ce7 admin admin] PATH_INFO: `/v3/projects/0671a6077f50440a93ec73983e40f301/users/0c57782706c64572b682a1724193c28b/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:21.573295 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f70c2-7d78-4d5a-8f12-8bfdc4b97350 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:21.575142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b45fba-2067-4f31-81c0-4ba7034c3ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0671a6077f50440a93ec73983e40f301, user_id=0c57782706c64572b682a1724193c28b, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:21.577932 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b45fba-2067-4f31-81c0-4ba7034c3ce7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:21.579345 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca9e3d-5887-488e-b2ff-74339c5d4c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:21.579952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca9e3d-5887-488e-b2ff-74339c5d4c15 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:21.580239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca9e3d-5887-488e-b2ff-74339c5d4c15 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:21.580512 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca9e3d-5887-488e-b2ff-74339c5d4c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:21.589794 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca9e3d-5887-488e-b2ff-74339c5d4c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:21.598700 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca9e3d-5887-488e-b2ff-74339c5d4c15 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:21.601453 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1398/2827] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:55:21.682724 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1430/2828] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:21 2022] PUT /identity/v3/projects/0671a6077f50440a93ec73983e40f301/users/0c57782706c64572b682a1724193c28b/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:21.686825 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca9e3d-5887-488e-b2ff-74339c5d4c15 service nova] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:21.696471 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca9e3d-5887-488e-b2ff-74339c5d4c15 service nova] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:21.754100 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1fe06-9b0c-496a-a4b1-bcf384f0188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:21.754761 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1fe06-9b0c-496a-a4b1-bcf384f0188c admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:21.755041 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1fe06-9b0c-496a-a4b1-bcf384f0188c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:21.755339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1fe06-9b0c-496a-a4b1-bcf384f0188c admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:21.755971 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1fe06-9b0c-496a-a4b1-bcf384f0188c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:21.757547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1fe06-9b0c-496a-a4b1-bcf384f0188c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:21.767492 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1399/2829] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:55:21.771917 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b45fba-2067-4f31-81c0-4ba7034c3ce7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:21.782773 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b45fba-2067-4f31-81c0-4ba7034c3ce7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:21.787335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff9678-c0c0-49e9-9d35-aa9b8d24315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:21.787980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff9678-c0c0-49e9-9d35-aa9b8d24315e admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:21.788262 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff9678-c0c0-49e9-9d35-aa9b8d24315e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:21.788536 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff9678-c0c0-49e9-9d35-aa9b8d24315e admin admin] PATH_INFO: `/v3/projects/0671a6077f50440a93ec73983e40f301/users/0c57782706c64572b682a1724193c28b/roles/38f75c8b41984e16bf66e035cfe922ee` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:21.790500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff9678-c0c0-49e9-9d35-aa9b8d24315e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0671a6077f50440a93ec73983e40f301, user_id=0c57782706c64572b682a1724193c28b, role_id=38f75c8b41984e16bf66e035cfe922ee)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:21.794124 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff9678-c0c0-49e9-9d35-aa9b8d24315e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:21.805442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1431/2830] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:21 2022] PUT /identity/v3/projects/0671a6077f50440a93ec73983e40f301/users/0c57782706c64572b682a1724193c28b/roles/38f75c8b41984e16bf66e035cfe922ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:21.835404 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0a50b-9dc2-4c14-8cd0-1764a3afc6d1 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:21.835677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0a50b-9dc2-4c14-8cd0-1764a3afc6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:21.835963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0a50b-9dc2-4c14-8cd0-1764a3afc6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:21.869487 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7ac0a50b-9dc2-4c14-8cd0-1764a3afc6d1 None None] MFA Rules not processed for user `0c57782706c64572b682a1724193c28b`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:21.871247 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7ac0a50b-9dc2-4c14-8cd0-1764a3afc6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:21.920851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=100 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:21.943641 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1400/2831] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:21.955641 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff9678-c0c0-49e9-9d35-aa9b8d24315e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:21.957426 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-13ff9678-c0c0-49e9-9d35-aa9b8d24315e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:22.016115 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff9678-c0c0-49e9-9d35-aa9b8d24315e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:22.019797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4840f-597d-4bee-99d2-1e2b5725574b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:22.020402 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4840f-597d-4bee-99d2-1e2b5725574b service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:22.020682 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4840f-597d-4bee-99d2-1e2b5725574b service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:22.020957 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4840f-597d-4bee-99d2-1e2b5725574b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:22.031278 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4840f-597d-4bee-99d2-1e2b5725574b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:22.032708 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4840f-597d-4bee-99d2-1e2b5725574b service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:22.042034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1432/2832] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:22.135484 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0a50b-9dc2-4c14-8cd0-1764a3afc6d1 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:22.145804 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0a50b-9dc2-4c14-8cd0-1764a3afc6d1 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:22.149399 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd6c46-33d1-464c-bbcb-483b3051c287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:22.149994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd6c46-33d1-464c-bbcb-483b3051c287 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:22.150319 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd6c46-33d1-464c-bbcb-483b3051c287 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:22.150594 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd6c46-33d1-464c-bbcb-483b3051c287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:22.209731 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd6c46-33d1-464c-bbcb-483b3051c287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:22.211245 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd6c46-33d1-464c-bbcb-483b3051c287 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:22.221362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1401/2833] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:26.725149 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4840f-597d-4bee-99d2-1e2b5725574b service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:26.793625 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4840f-597d-4bee-99d2-1e2b5725574b service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:26.798131 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:26.798791 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:26.799077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:26.799381 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] PATH_INFO: `/v3/users/23589464135a411295c36546407f241e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:26.800492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23589464135a411295c36546407f241e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:26.802456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:26.812979 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:27.085079 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23589464135a411295c36546407f241e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:27.085735 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23589464135a411295c36546407f241e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:27.093133 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23589464135a411295c36546407f241e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:27.114157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23589464135a411295c36546407f241e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:27.189956 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23589464135a411295c36546407f241e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:27.196333 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1433/2834] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:26 2022] DELETE /identity/v3/users/23589464135a411295c36546407f241e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:27.202142 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516469-3845-4b0a-9ae4-35fef667784b None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:27.202612 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516469-3845-4b0a-9ae4-35fef667784b None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:27.202715 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516469-3845-4b0a-9ae4-35fef667784b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:27.222255 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-5f516469-3845-4b0a-9ae4-35fef667784b None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:27.226292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5f516469-3845-4b0a-9ae4-35fef667784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:27.282341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1402/2835] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:27.292224 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:27.294139 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:27.374269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1489104-18ee-41d1-9abc-d03f8a59ff7e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:27.377929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202661-313e-4b63-ad65-f9492615ab2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:27.378570 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202661-313e-4b63-ad65-f9492615ab2d service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:27.378856 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202661-313e-4b63-ad65-f9492615ab2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:27.379126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202661-313e-4b63-ad65-f9492615ab2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:27.388265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02202661-313e-4b63-ad65-f9492615ab2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:27.389732 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02202661-313e-4b63-ad65-f9492615ab2d service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:27.399103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1434/2836] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:27.774566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f516469-3845-4b0a-9ae4-35fef667784b None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:27.776075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-5f516469-3845-4b0a-9ae4-35fef667784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:27.790424 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f516469-3845-4b0a-9ae4-35fef667784b None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:27.796309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:27.797597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:27.797597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:27.797597 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] PATH_INFO: `/v3/projects/edacdddc1d74476b8f9dbcc0ae804059` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:27.798737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edacdddc1d74476b8f9dbcc0ae804059)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:27.800571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:27.889346 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edacdddc1d74476b8f9dbcc0ae804059', 'request_id': 'req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:27.955984 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edacdddc1d74476b8f9dbcc0ae804059', 'request_id': 'req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:27.966070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edacdddc1d74476b8f9dbcc0ae804059', 'request_id': 'req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:27.975020 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] The token cache is being invalidate because project edacdddc1d74476b8f9dbcc0ae804059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:27.975316 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:27.975952 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:27.977470 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1403/2837] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:27 2022] DELETE /identity/v3/projects/edacdddc1d74476b8f9dbcc0ae804059 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:27.981517 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202661-313e-4b63-ad65-f9492615ab2d service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:27.990990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202661-313e-4b63-ad65-f9492615ab2d service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:28.047626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:28.048251 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:28.048530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:28.048806 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] PATH_INFO: `/v3/users/7484b9dc92b9473a935331e7c714839e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:28.049901 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7484b9dc92b9473a935331e7c714839e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:28.051842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:28.063968 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:28.182625 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:28.184555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:28.197220 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92e3a4-b716-4ae5-85dd-e17acbcc9838 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:28.202376 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:28.202991 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:28.203271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:28.203543 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] PATH_INFO: `/v3/users/191db14d35aa46b9a70c0ac66fc3fe1c` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:28.204753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191db14d35aa46b9a70c0ac66fc3fe1c)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:28.206678 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:28.208159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:28.272284 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7484b9dc92b9473a935331e7c714839e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.272853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7484b9dc92b9473a935331e7c714839e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.279621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7484b9dc92b9473a935331e7c714839e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.291507 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7484b9dc92b9473a935331e7c714839e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.373237 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-59002f5d-a00f-4fa4-88df-9814e7d5b9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7484b9dc92b9473a935331e7c714839e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.379394 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1435/2838] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:27 2022] DELETE /identity/v3/users/7484b9dc92b9473a935331e7c714839e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:28.410454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191db14d35aa46b9a70c0ac66fc3fe1c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.426564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191db14d35aa46b9a70c0ac66fc3fe1c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.510379 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191db14d35aa46b9a70c0ac66fc3fe1c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.518912 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191db14d35aa46b9a70c0ac66fc3fe1c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.520555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191db14d35aa46b9a70c0ac66fc3fe1c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.525654 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1404/2839] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:28 2022] DELETE /identity/v3/users/191db14d35aa46b9a70c0ac66fc3fe1c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:28.530493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee41ae-f466-403b-a7ac-9d41a6349698 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:28.530779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee41ae-f466-403b-a7ac-9d41a6349698 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:28.531052 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee41ae-f466-403b-a7ac-9d41a6349698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:28.553072 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f1ee41ae-f466-403b-a7ac-9d41a6349698 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:28.553941 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f1ee41ae-f466-403b-a7ac-9d41a6349698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:28.615676 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1436/2840] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:28.628957 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:28.630472 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:28.690883 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b70570-53e7-44c4-b2e3-beff5fd44579 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:28.694980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fc8b3-e62d-48a9-8647-704625f526fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:28.695621 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fc8b3-e62d-48a9-8647-704625f526fa service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:28.695899 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fc8b3-e62d-48a9-8647-704625f526fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:28.696165 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fc8b3-e62d-48a9-8647-704625f526fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:28.706283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fc8b3-e62d-48a9-8647-704625f526fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:28.707717 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fc8b3-e62d-48a9-8647-704625f526fa service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:28.718064 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1405/2841] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:28.769567 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee41ae-f466-403b-a7ac-9d41a6349698 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:28.771112 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f1ee41ae-f466-403b-a7ac-9d41a6349698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:28.784260 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee41ae-f466-403b-a7ac-9d41a6349698 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:28.789537 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:28.790351 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:28.790735 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:28.791317 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] PATH_INFO: `/v3/projects/e2e4782fff4c4bbca587af2dcbec198c` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:28.792565 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e4782fff4c4bbca587af2dcbec198c)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:28.795404 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:28.888577 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e4782fff4c4bbca587af2dcbec198c', 'request_id': 'req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.894853 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e4782fff4c4bbca587af2dcbec198c', 'request_id': 'req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.961838 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e4782fff4c4bbca587af2dcbec198c', 'request_id': 'req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.973599 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] The token cache is being invalidate because project e2e4782fff4c4bbca587af2dcbec198c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:28.973954 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.974638 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:28.976383 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1437/2842] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:28 2022] DELETE /identity/v3/projects/e2e4782fff4c4bbca587af2dcbec198c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:28.980262 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fc8b3-e62d-48a9-8647-704625f526fa service neutron] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:28.991617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fc8b3-e62d-48a9-8647-704625f526fa service neutron] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:29.054495 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:29.055239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:29.055522 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:29.055799 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] PATH_INFO: `/v3/users/0c57782706c64572b682a1724193c28b` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:29.056943 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c57782706c64572b682a1724193c28b)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:29.058964 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:29.085341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:29.177713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:29.179519 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:29.193455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886b0da-3b7c-472a-affd-dcc5dcf7d2bd admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:29.198703 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:29.201579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:29.201579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:29.201579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] PATH_INFO: `/v3/projects/7019df6753974221810ffffd45b4ba4a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:29.201579 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7019df6753974221810ffffd45b4ba4a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:29.203312 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:29.212057 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:29.255372 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c57782706c64572b682a1724193c28b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.266976 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c57782706c64572b682a1724193c28b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.305397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7019df6753974221810ffffd45b4ba4a', 'request_id': 'req-639a593e-62d1-4209-80b6-d3f40df54594'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.312232 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7019df6753974221810ffffd45b4ba4a', 'request_id': 'req-639a593e-62d1-4209-80b6-d3f40df54594'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.338985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c57782706c64572b682a1724193c28b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.347478 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c57782706c64572b682a1724193c28b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.348229 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-6a094b04-54ca-4c0b-8422-8e0dcf08b281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c57782706c64572b682a1724193c28b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.354333 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1406/2843] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:28 2022] DELETE /identity/v3/users/0c57782706c64572b682a1724193c28b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:29.413147 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7019df6753974221810ffffd45b4ba4a', 'request_id': 'req-639a593e-62d1-4209-80b6-d3f40df54594'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.424456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] The token cache is being invalidate because project 7019df6753974221810ffffd45b4ba4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:29.424750 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.425384 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-639a593e-62d1-4209-80b6-d3f40df54594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.426897 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1438/2844] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:29 2022] DELETE /identity/v3/projects/7019df6753974221810ffffd45b4ba4a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:29.432593 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd33f8-d73f-402d-9d37-931318e6b6ba None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:29.432814 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd33f8-d73f-402d-9d37-931318e6b6ba None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:29.433096 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd33f8-d73f-402d-9d37-931318e6b6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:29.454968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-77dd33f8-d73f-402d-9d37-931318e6b6ba None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:29.456177 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-77dd33f8-d73f-402d-9d37-931318e6b6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:29.515813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1407/2845] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:29.523913 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489fe49-f970-4dc5-8b0d-18023e032673 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:29.524207 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489fe49-f970-4dc5-8b0d-18023e032673 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:29.524491 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489fe49-f970-4dc5-8b0d-18023e032673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:29.545891 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e489fe49-f970-4dc5-8b0d-18023e032673 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:29.547273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e489fe49-f970-4dc5-8b0d-18023e032673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:29.555476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1439/2846] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:29.559837 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd33f8-d73f-402d-9d37-931318e6b6ba None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:29.569854 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd33f8-d73f-402d-9d37-931318e6b6ba None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:29.576589 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9801494-7f36-4c24-9f6c-2e324ebde011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:29.581882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9801494-7f36-4c24-9f6c-2e324ebde011 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:29.581882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9801494-7f36-4c24-9f6c-2e324ebde011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:29.581882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9801494-7f36-4c24-9f6c-2e324ebde011 admin admin] PATH_INFO: `/v3/domains` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:29.581882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9801494-7f36-4c24-9f6c-2e324ebde011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:55:29.581882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9801494-7f36-4c24-9f6c-2e324ebde011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:29.581882 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9801494-7f36-4c24-9f6c-2e324ebde011 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:29.596225 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1408/2847] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:55:29.600888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489fe49-f970-4dc5-8b0d-18023e032673 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:29.610705 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489fe49-f970-4dc5-8b0d-18023e032673 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:29.616406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce11674-1fe1-4617-bfe2-c00d7a60fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:29.616406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce11674-1fe1-4617-bfe2-c00d7a60fcf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:29.616406 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce11674-1fe1-4617-bfe2-c00d7a60fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:29.616738 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce11674-1fe1-4617-bfe2-c00d7a60fcf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:29.617242 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce11674-1fe1-4617-bfe2-c00d7a60fcf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:29.619269 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce11674-1fe1-4617-bfe2-c00d7a60fcf3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:29.729020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1440/2848] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:55:29 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:55:29.733430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9801494-7f36-4c24-9f6c-2e324ebde011 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:29.743582 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9801494-7f36-4c24-9f6c-2e324ebde011 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:29.775056 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce11674-1fe1-4617-bfe2-c00d7a60fcf3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:29.776894 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bce11674-1fe1-4617-bfe2-c00d7a60fcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:29.815313 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687a48-7165-438a-9d55-d2d4080247d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:29.815970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687a48-7165-438a-9d55-d2d4080247d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:29.816248 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687a48-7165-438a-9d55-d2d4080247d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:29.816521 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687a48-7165-438a-9d55-d2d4080247d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:29.817183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687a48-7165-438a-9d55-d2d4080247d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:29.819177 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687a48-7165-438a-9d55-d2d4080247d3 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:29.851143 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce11674-1fe1-4617-bfe2-c00d7a60fcf3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:29.856888 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:29.857653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:29.858293 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:29.860006 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] PATH_INFO: `/v3/projects/0671a6077f50440a93ec73983e40f301` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:29.860548 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0671a6077f50440a93ec73983e40f301)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:29.862497 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:29.921734 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1409/2849] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:55:29 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:55:29.925898 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687a48-7165-438a-9d55-d2d4080247d3 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:29.936191 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687a48-7165-438a-9d55-d2d4080247d3 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:29.940963 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1089bf-3fb1-460d-84c8-a0604528cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:29.941555 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1089bf-3fb1-460d-84c8-a0604528cc06 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:29.941842 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1089bf-3fb1-460d-84c8-a0604528cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:29.942119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1089bf-3fb1-460d-84c8-a0604528cc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:29.942793 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1089bf-3fb1-460d-84c8-a0604528cc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:29.944374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1089bf-3fb1-460d-84c8-a0604528cc06 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:29.955618 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1410/2850] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:55:29.959529 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1089bf-3fb1-460d-84c8-a0604528cc06 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:29.969451 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1089bf-3fb1-460d-84c8-a0604528cc06 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:29.974307 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291923a-7f3f-405e-9cb2-ec749ca1275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:29.977788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291923a-7f3f-405e-9cb2-ec749ca1275b admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:29.977788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291923a-7f3f-405e-9cb2-ec749ca1275b admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:29.977788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291923a-7f3f-405e-9cb2-ec749ca1275b admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:29.977788 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291923a-7f3f-405e-9cb2-ec749ca1275b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:29.978223 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291923a-7f3f-405e-9cb2-ec749ca1275b admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:29.979271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:29.985300 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0671a6077f50440a93ec73983e40f301', 'request_id': 'req-773302f2-f546-4fa9-afa9-fdd512bb1302'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.991465 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1411/2851] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:55:29.991869 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0671a6077f50440a93ec73983e40f301', 'request_id': 'req-773302f2-f546-4fa9-afa9-fdd512bb1302'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:29.992636 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291923a-7f3f-405e-9cb2-ec749ca1275b admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:30.002896 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291923a-7f3f-405e-9cb2-ec749ca1275b admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:30.057682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdc38f-5a79-4fb4-bb89-6a200bdef4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:30.058673 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdc38f-5a79-4fb4-bb89-6a200bdef4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.059580 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdc38f-5a79-4fb4-bb89-6a200bdef4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.060057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdc38f-5a79-4fb4-bb89-6a200bdef4ce admin admin] PATH_INFO: `/v3/projects/1e9d0f633aa04ac6aca73ce40c400628/users/08301ba0382a4278baf5119b3c40d4f2/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.074553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdc38f-5a79-4fb4-bb89-6a200bdef4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9d0f633aa04ac6aca73ce40c400628, user_id=08301ba0382a4278baf5119b3c40d4f2, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:30.076101 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0671a6077f50440a93ec73983e40f301', 'request_id': 'req-773302f2-f546-4fa9-afa9-fdd512bb1302'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:30.077374 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdc38f-5a79-4fb4-bb89-6a200bdef4ce admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:30.083225 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:30.087868 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] The token cache is being invalidate because project 0671a6077f50440a93ec73983e40f301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:30.088161 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:30.088898 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-773302f2-f546-4fa9-afa9-fdd512bb1302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:30.090740 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1441/2852] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:29 2022] DELETE /identity/v3/projects/0671a6077f50440a93ec73983e40f301 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:30.097980 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fe37e-89bf-46e6-a06a-7d22b5d63d82 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.098335 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fe37e-89bf-46e6-a06a-7d22b5d63d82 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.098621 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fe37e-89bf-46e6-a06a-7d22b5d63d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.118220 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-223fe37e-89bf-46e6-a06a-7d22b5d63d82 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:30.119440 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-223fe37e-89bf-46e6-a06a-7d22b5d63d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:30.128038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1442/2853] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:30.137427 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb967a2-1842-476a-b167-6c3035c1f2db None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.142223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb967a2-1842-476a-b167-6c3035c1f2db None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.142223 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb967a2-1842-476a-b167-6c3035c1f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.156845 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1fb967a2-1842-476a-b167-6c3035c1f2db None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:30.158034 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1fb967a2-1842-476a-b167-6c3035c1f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:30.165935 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1443/2854] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:30.167755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1412/2855] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:29 2022] PUT /identity/v3/projects/1e9d0f633aa04ac6aca73ce40c400628/users/08301ba0382a4278baf5119b3c40d4f2/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:55:30.174801 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb967a2-1842-476a-b167-6c3035c1f2db None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:30.180600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435906-9894-45c2-9d0d-515fcc46eaf2 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.181855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435906-9894-45c2-9d0d-515fcc46eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.182526 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435906-9894-45c2-9d0d-515fcc46eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.185962 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb967a2-1842-476a-b167-6c3035c1f2db None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:30.219383 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-b8435906-9894-45c2-9d0d-515fcc46eaf2 None None] MFA Rules not processed for user `08301ba0382a4278baf5119b3c40d4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:30.220599 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b8435906-9894-45c2-9d0d-515fcc46eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:30.252476 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38781d-adf5-4282-9897-04d1c2fcb798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:30.253015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38781d-adf5-4282-9897-04d1c2fcb798 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.253454 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38781d-adf5-4282-9897-04d1c2fcb798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.253735 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38781d-adf5-4282-9897-04d1c2fcb798 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.254419 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38781d-adf5-4282-9897-04d1c2fcb798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:55:30.254725 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38781d-adf5-4282-9897-04d1c2fcb798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:30.256397 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38781d-adf5-4282-9897-04d1c2fcb798 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:30.268563 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1444/2856] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:55:30.273954 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38781d-adf5-4282-9897-04d1c2fcb798 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:30.288214 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38781d-adf5-4282-9897-04d1c2fcb798 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:30.294103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126454-602a-4af1-9933-41e33321580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:30.294745 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126454-602a-4af1-9933-41e33321580c admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.295027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126454-602a-4af1-9933-41e33321580c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.295303 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126454-602a-4af1-9933-41e33321580c admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.295714 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1413/2857] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:30.298508 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c126454-602a-4af1-9933-41e33321580c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:30.301027 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c126454-602a-4af1-9933-41e33321580c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:30.308133 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435906-9894-45c2-9d0d-515fcc46eaf2 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:30.309695 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-b8435906-9894-45c2-9d0d-515fcc46eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:30.368951 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435906-9894-45c2-9d0d-515fcc46eaf2 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:30.373206 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc16c28-4508-4e53-b7a9-cfabc0cc6c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:30.373805 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc16c28-4508-4e53-b7a9-cfabc0cc6c69 service cinder] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.374086 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc16c28-4508-4e53-b7a9-cfabc0cc6c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.374387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc16c28-4508-4e53-b7a9-cfabc0cc6c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.382885 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc16c28-4508-4e53-b7a9-cfabc0cc6c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:30.384309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc16c28-4508-4e53-b7a9-cfabc0cc6c69 service cinder] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:30.393400 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1414/2858] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:55:30.403569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1445/2859] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:55:30 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:55:30.403699 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc16c28-4508-4e53-b7a9-cfabc0cc6c69 service cinder] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:30.413866 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc16c28-4508-4e53-b7a9-cfabc0cc6c69 service cinder] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:30.423054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:30.473994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f97ea1-6b28-4494-844c-51af9504082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:30.474792 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f97ea1-6b28-4494-844c-51af9504082f admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.475282 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f97ea1-6b28-4494-844c-51af9504082f admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.475779 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f97ea1-6b28-4494-844c-51af9504082f admin admin] PATH_INFO: `/v3/users` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.476876 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f97ea1-6b28-4494-844c-51af9504082f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:30.479240 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f97ea1-6b28-4494-844c-51af9504082f admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:30.562452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1415/2860] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:55:30 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:55:30.566063 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126454-602a-4af1-9933-41e33321580c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:30.576912 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126454-602a-4af1-9933-41e33321580c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:30.581582 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a60a69-9b1a-42e1-bc1c-b3f2efca85d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:30.582181 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a60a69-9b1a-42e1-bc1c-b3f2efca85d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.582492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a60a69-9b1a-42e1-bc1c-b3f2efca85d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.582793 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a60a69-9b1a-42e1-bc1c-b3f2efca85d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.583551 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a60a69-9b1a-42e1-bc1c-b3f2efca85d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:30.585190 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a60a69-9b1a-42e1-bc1c-b3f2efca85d7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:30.595823 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1446/2861] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:30.599614 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f97ea1-6b28-4494-844c-51af9504082f admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:30.610495 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f97ea1-6b28-4494-844c-51af9504082f admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:30.615250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439dfab-d28c-4ed1-8905-c5d29bdb52fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:30.615931 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439dfab-d28c-4ed1-8905-c5d29bdb52fa admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.616266 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439dfab-d28c-4ed1-8905-c5d29bdb52fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.616547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439dfab-d28c-4ed1-8905-c5d29bdb52fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.617192 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439dfab-d28c-4ed1-8905-c5d29bdb52fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:30.618816 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439dfab-d28c-4ed1-8905-c5d29bdb52fa admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:30.628970 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1416/2862] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:30.633179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a60a69-9b1a-42e1-bc1c-b3f2efca85d7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:30.643561 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a60a69-9b1a-42e1-bc1c-b3f2efca85d7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:30.648374 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1726b8-67ab-40f6-a83b-08dc58a0e46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:30.649024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1726b8-67ab-40f6-a83b-08dc58a0e46d admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.649338 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1726b8-67ab-40f6-a83b-08dc58a0e46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.649620 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1726b8-67ab-40f6-a83b-08dc58a0e46d admin admin] PATH_INFO: `/v3/projects/5666fdc0ef684019a4bcc3063e2a2de2/users/c952fc347ee542ada2abdc72abe3983b/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.664802 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1726b8-67ab-40f6-a83b-08dc58a0e46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5666fdc0ef684019a4bcc3063e2a2de2, user_id=c952fc347ee542ada2abdc72abe3983b, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:30.667627 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1726b8-67ab-40f6-a83b-08dc58a0e46d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:30.756088 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1447/2863] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:30 2022] PUT /identity/v3/projects/5666fdc0ef684019a4bcc3063e2a2de2/users/c952fc347ee542ada2abdc72abe3983b/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:30.767314 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d5747-ca43-4440-baaf-f2f9cd7ad3d6 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.767600 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d5747-ca43-4440-baaf-f2f9cd7ad3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.767983 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d5747-ca43-4440-baaf-f2f9cd7ad3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.798549 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-581d5747-ca43-4440-baaf-f2f9cd7ad3d6 None None] MFA Rules not processed for user `c952fc347ee542ada2abdc72abe3983b`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:30.799740 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-581d5747-ca43-4440-baaf-f2f9cd7ad3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:30.866338 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1417/2864] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:30.878488 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1726b8-67ab-40f6-a83b-08dc58a0e46d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:30.880176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9d1726b8-67ab-40f6-a83b-08dc58a0e46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:30.936527 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1726b8-67ab-40f6-a83b-08dc58a0e46d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:30.940184 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb93cf6-3a83-4779-8be1-01bd74b5a0ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80696f8fcd8e4d01b303bdfd81a6dc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:30.940788 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb93cf6-3a83-4779-8be1-01bd74b5a0ab service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:30.941077 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb93cf6-3a83-4779-8be1-01bd74b5a0ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:30.941352 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb93cf6-3a83-4779-8be1-01bd74b5a0ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:30.949451 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb93cf6-3a83-4779-8be1-01bd74b5a0ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:30.951603 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb93cf6-3a83-4779-8be1-01bd74b5a0ab service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:30.960469 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1448/2865] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:33.204321 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d5747-ca43-4440-baaf-f2f9cd7ad3d6 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:33.206694 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-581d5747-ca43-4440-baaf-f2f9cd7ad3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:33.300239 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:33.304440 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d5747-ca43-4440-baaf-f2f9cd7ad3d6 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:33.310026 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581ec28-1181-4198-8042-5ab64b6fdd0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8495c97df48f18b10039584d52f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:33.310674 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581ec28-1181-4198-8042-5ab64b6fdd0c service placement] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:33.310954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581ec28-1181-4198-8042-5ab64b6fdd0c service placement] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:33.311226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581ec28-1181-4198-8042-5ab64b6fdd0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:33.312929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-2581ec28-1181-4198-8042-5ab64b6fdd0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:33.324173 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581ec28-1181-4198-8042-5ab64b6fdd0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:33.325986 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581ec28-1181-4198-8042-5ab64b6fdd0c service placement] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:33.335584 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1418/2866] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:33.621831 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb93cf6-3a83-4779-8be1-01bd74b5a0ab service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:33.623371 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0cb93cf6-3a83-4779-8be1-01bd74b5a0ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:33.650830 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:33.689466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb93cf6-3a83-4779-8be1-01bd74b5a0ab service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:33.694610 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:33.695249 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:33.695530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:33.695808 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] PATH_INFO: `/v3/users/08301ba0382a4278baf5119b3c40d4f2` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:33.696949 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08301ba0382a4278baf5119b3c40d4f2)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:33.699020 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:33.833047 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08301ba0382a4278baf5119b3c40d4f2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:33.833713 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08301ba0382a4278baf5119b3c40d4f2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:33.841365 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08301ba0382a4278baf5119b3c40d4f2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:33.853466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08301ba0382a4278baf5119b3c40d4f2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:33.950896 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08301ba0382a4278baf5119b3c40d4f2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:33.957629 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1449/2867] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:33 2022] DELETE /identity/v3/users/08301ba0382a4278baf5119b3c40d4f2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:33.962144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165969b-ac24-4c5f-a7a0-468af4e32e0a None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:33.962571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165969b-ac24-4c5f-a7a0-468af4e32e0a None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:33.962853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165969b-ac24-4c5f-a7a0-468af4e32e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:33.983309 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-1165969b-ac24-4c5f-a7a0-468af4e32e0a None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:33.984578 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1165969b-ac24-4c5f-a7a0-468af4e32e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:34.044548 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1419/2868] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:34.054539 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:34.055993 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:34.113349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31439b-f0d2-4aa7-8442-8946095acc43 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:34.116931 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1522a4-8043-474c-9029-1a192e37bb2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:34.117530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1522a4-8043-474c-9029-1a192e37bb2c service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:34.117810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1522a4-8043-474c-9029-1a192e37bb2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:34.118084 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1522a4-8043-474c-9029-1a192e37bb2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:34.127493 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1522a4-8043-474c-9029-1a192e37bb2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:34.128929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1522a4-8043-474c-9029-1a192e37bb2c service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:34.139313 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1450/2869] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:34.592269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165969b-ac24-4c5f-a7a0-468af4e32e0a None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:34.593737 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-1165969b-ac24-4c5f-a7a0-468af4e32e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:34.606617 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165969b-ac24-4c5f-a7a0-468af4e32e0a None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:34.611275 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:34.611949 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:34.612233 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:34.612503 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] PATH_INFO: `/v3/projects/1e9d0f633aa04ac6aca73ce40c400628` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:34.613634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9d0f633aa04ac6aca73ce40c400628)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:34.615660 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:34.765936 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9d0f633aa04ac6aca73ce40c400628', 'request_id': 'req-748ac27f-00f8-4a72-af15-ea9cd5cec059'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:34.905057 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9d0f633aa04ac6aca73ce40c400628', 'request_id': 'req-748ac27f-00f8-4a72-af15-ea9cd5cec059'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:34.911076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9d0f633aa04ac6aca73ce40c400628', 'request_id': 'req-748ac27f-00f8-4a72-af15-ea9cd5cec059'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:34.923089 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] The token cache is being invalidate because project 1e9d0f633aa04ac6aca73ce40c400628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:34.923364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:34.924008 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-748ac27f-00f8-4a72-af15-ea9cd5cec059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:34.925494 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1420/2870] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:34 2022] DELETE /identity/v3/projects/1e9d0f633aa04ac6aca73ce40c400628 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:34.930353 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3659e-8d13-4c4c-ac9b-08f749329f5d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:34.930821 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3659e-8d13-4c4c-ac9b-08f749329f5d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:34.930920 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3659e-8d13-4c4c-ac9b-08f749329f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:34.951264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-07e3659e-8d13-4c4c-ac9b-08f749329f5d None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:34.952455 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-07e3659e-8d13-4c4c-ac9b-08f749329f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:34.994887 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:35.012248 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1451/2871] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:35.020067 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c2a7b-720e-4080-ad2e-0be20b91b7d8 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:35.020362 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c2a7b-720e-4080-ad2e-0be20b91b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:35.020640 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c2a7b-720e-4080-ad2e-0be20b91b7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:35.041070 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-9a7c2a7b-720e-4080-ad2e-0be20b91b7d8 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:35.042339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-9a7c2a7b-720e-4080-ad2e-0be20b91b7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:35.051549 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1421/2872] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:35.055775 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3659e-8d13-4c4c-ac9b-08f749329f5d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:35.065442 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3659e-8d13-4c4c-ac9b-08f749329f5d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:35.070104 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278b10c-d47b-4048-b554-3f66edfd9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:35.070727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278b10c-d47b-4048-b554-3f66edfd9f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:35.071013 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278b10c-d47b-4048-b554-3f66edfd9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:35.071428 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278b10c-d47b-4048-b554-3f66edfd9f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:35.072080 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278b10c-d47b-4048-b554-3f66edfd9f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:55:35.072387 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278b10c-d47b-4048-b554-3f66edfd9f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:35.073977 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278b10c-d47b-4048-b554-3f66edfd9f3e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:35.085780 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1452/2873] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 22 12:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:55:35.090677 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c2a7b-720e-4080-ad2e-0be20b91b7d8 None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:35.100755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c2a7b-720e-4080-ad2e-0be20b91b7d8 None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:35.108054 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443e309-4b60-4692-891d-7a52e9f360bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:35.108663 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e309-4b60-4692-891d-7a52e9f360bd admin admin] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:35.114644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e309-4b60-4692-891d-7a52e9f360bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:35.114644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e309-4b60-4692-891d-7a52e9f360bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:35.114644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443e309-4b60-4692-891d-7a52e9f360bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:35.114644 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443e309-4b60-4692-891d-7a52e9f360bd admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:35.233813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1422/2874] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 22 12:55:35 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:55:35.238179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278b10c-d47b-4048-b554-3f66edfd9f3e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:35.251967 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278b10c-d47b-4048-b554-3f66edfd9f3e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:35.313730 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f662ca0-04b2-427a-a015-2646232ed779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:35.314364 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f662ca0-04b2-427a-a015-2646232ed779 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:35.314648 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f662ca0-04b2-427a-a015-2646232ed779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:35.314923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f662ca0-04b2-427a-a015-2646232ed779 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:35.315532 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f662ca0-04b2-427a-a015-2646232ed779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:35.317466 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f662ca0-04b2-427a-a015-2646232ed779 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:35.402009 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1453/2875] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 22 12:55:35 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:55:35.406490 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443e309-4b60-4692-891d-7a52e9f360bd admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:35.416561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443e309-4b60-4692-891d-7a52e9f360bd admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:35.421485 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322526a-a778-4237-b970-c8b6ab5f0ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:35.422076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322526a-a778-4237-b970-c8b6ab5f0ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:35.422384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322526a-a778-4237-b970-c8b6ab5f0ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:35.422922 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322526a-a778-4237-b970-c8b6ab5f0ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:35.423604 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322526a-a778-4237-b970-c8b6ab5f0ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:35.425250 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322526a-a778-4237-b970-c8b6ab5f0ca8 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:35.435564 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1423/2876] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:35.439495 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f662ca0-04b2-427a-a015-2646232ed779 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:35.450653 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f662ca0-04b2-427a-a015-2646232ed779 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:35.455571 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c43bac-6ad2-42f4-a245-0db28f33bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:35.456174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43bac-6ad2-42f4-a245-0db28f33bbaf admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:35.456453 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43bac-6ad2-42f4-a245-0db28f33bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:35.456726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43bac-6ad2-42f4-a245-0db28f33bbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:35.457401 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c43bac-6ad2-42f4-a245-0db28f33bbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:35.459028 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c43bac-6ad2-42f4-a245-0db28f33bbaf admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:35.471041 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1454/2877] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 22 12:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:55:35.475177 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322526a-a778-4237-b970-c8b6ab5f0ca8 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:35.485226 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322526a-a778-4237-b970-c8b6ab5f0ca8 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:35.489813 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35102f0-3e3e-4d74-858a-eaf792813f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:35.490464 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35102f0-3e3e-4d74-858a-eaf792813f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:35.490748 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35102f0-3e3e-4d74-858a-eaf792813f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:35.491021 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35102f0-3e3e-4d74-858a-eaf792813f63 admin admin] PATH_INFO: `/v3/projects/bbd893b217f3416a80d4bc3fb9df24d0/users/f02f6ad2eea64e03bc70e58af064dae6/roles/a09ff6a1ba5641ff96d63b8109bf1f7e` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:35.506284 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35102f0-3e3e-4d74-858a-eaf792813f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd893b217f3416a80d4bc3fb9df24d0, user_id=f02f6ad2eea64e03bc70e58af064dae6, role_id=a09ff6a1ba5641ff96d63b8109bf1f7e)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:35.515076 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35102f0-3e3e-4d74-858a-eaf792813f63 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:35.619270 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1424/2878] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 22 12:55:35 2022] PUT /identity/v3/projects/bbd893b217f3416a80d4bc3fb9df24d0/users/f02f6ad2eea64e03bc70e58af064dae6/roles/a09ff6a1ba5641ff96d63b8109bf1f7e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:35.630349 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5a3a4-f7eb-49ce-a963-f5efd927daa7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:35.630646 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5a3a4-f7eb-49ce-a963-f5efd927daa7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:35.630924 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5a3a4-f7eb-49ce-a963-f5efd927daa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:35.658958 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-55d5a3a4-f7eb-49ce-a963-f5efd927daa7 None None] MFA Rules not processed for user `f02f6ad2eea64e03bc70e58af064dae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:35.660174 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-55d5a3a4-f7eb-49ce-a963-f5efd927daa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:35.724752 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1455/2879] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:55:35.736634 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35102f0-3e3e-4d74-858a-eaf792813f63 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:35.738498 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c35102f0-3e3e-4d74-858a-eaf792813f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:35.750299 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:35.796271 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35102f0-3e3e-4d74-858a-eaf792813f63 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:35.800159 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea21214-30e1-4f01-a262-f41074af9d3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e56c9d900f4e4e91ea944d4cb0a40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:35.800869 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea21214-30e1-4f01-a262-f41074af9d3f service glance] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:35.801156 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea21214-30e1-4f01-a262-f41074af9d3f service glance] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:35.801430 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea21214-30e1-4f01-a262-f41074af9d3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:35.810423 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea21214-30e1-4f01-a262-f41074af9d3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:35.812851 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea21214-30e1-4f01-a262-f41074af9d3f service glance] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:35.822711 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1425/2880] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:39.185126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362177d-6546-4732-8107-09d3d7ab0207 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:39.185126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362177d-6546-4732-8107-09d3d7ab0207 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:39.185126 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362177d-6546-4732-8107-09d3d7ab0207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:39.203307 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0362177d-6546-4732-8107-09d3d7ab0207 None None] MFA Rules not processed for user `c1567c2e8dd3472690387fae64d3ae54`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:39.204747 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0362177d-6546-4732-8107-09d3d7ab0207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:39.249925 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:39.271390 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1456/2881] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:43.093753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea21214-30e1-4f01-a262-f41074af9d3f service glance] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:43.096390 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7ea21214-30e1-4f01-a262-f41074af9d3f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:43.166844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea21214-30e1-4f01-a262-f41074af9d3f service glance] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:43.172542 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:43.173219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:43.173502 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:43.173782 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] PATH_INFO: `/v3/users/c952fc347ee542ada2abdc72abe3983b` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:43.174969 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c952fc347ee542ada2abdc72abe3983b)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:43.176911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:43.374905 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c952fc347ee542ada2abdc72abe3983b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:43.386592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c952fc347ee542ada2abdc72abe3983b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:43.470803 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c952fc347ee542ada2abdc72abe3983b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:43.479113 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c952fc347ee542ada2abdc72abe3983b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:43.479846 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c952fc347ee542ada2abdc72abe3983b'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:43.485954 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1426/2882] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:55:43 2022] DELETE /identity/v3/users/c952fc347ee542ada2abdc72abe3983b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:43.490554 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbc249-9ac8-4831-8204-9897266a580e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:43.491038 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbc249-9ac8-4831-8204-9897266a580e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:43.491142 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbc249-9ac8-4831-8204-9897266a580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:43.510172 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8fbbc249-9ac8-4831-8204-9897266a580e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:43.511484 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8fbbc249-9ac8-4831-8204-9897266a580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:43.580911 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1457/2883] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:43.591583 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:43.593624 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:43.658230 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:43.681189 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162e0fb-fb88-483d-9402-eeb148512352 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:43.686308 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201048e8-e09a-46a6-a96c-0b512bd32048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:43.686947 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201048e8-e09a-46a6-a96c-0b512bd32048 service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:43.687219 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201048e8-e09a-46a6-a96c-0b512bd32048 service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:43.687535 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201048e8-e09a-46a6-a96c-0b512bd32048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:43.699394 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201048e8-e09a-46a6-a96c-0b512bd32048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:43.700938 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201048e8-e09a-46a6-a96c-0b512bd32048 service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:43.712440 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1427/2884] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:44.192264 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbc249-9ac8-4831-8204-9897266a580e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:44.193972 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8fbbc249-9ac8-4831-8204-9897266a580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:44.221626 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbc249-9ac8-4831-8204-9897266a580e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:44.227422 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:44.228244 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:44.228533 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:44.228816 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] PATH_INFO: `/v3/projects/5666fdc0ef684019a4bcc3063e2a2de2` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:44.230005 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5666fdc0ef684019a4bcc3063e2a2de2)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:44.231976 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:44.336560 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5666fdc0ef684019a4bcc3063e2a2de2', 'request_id': 'req-047419ac-18bc-4df5-82f1-3778e289af4a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:44.346098 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5666fdc0ef684019a4bcc3063e2a2de2', 'request_id': 'req-047419ac-18bc-4df5-82f1-3778e289af4a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:44.395640 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5666fdc0ef684019a4bcc3063e2a2de2', 'request_id': 'req-047419ac-18bc-4df5-82f1-3778e289af4a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:44.412717 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] The token cache is being invalidate because project 5666fdc0ef684019a4bcc3063e2a2de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:55:44.412923 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:44.413608 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:55:44.415412 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1458/2885] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:55:44 2022] DELETE /identity/v3/projects/5666fdc0ef684019a4bcc3063e2a2de2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:55:53.876078 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=12 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:54.405779 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:55.870581 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b173a-d2be-4922-8668-2f0ac9864037 None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:55.871141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b173a-d2be-4922-8668-2f0ac9864037 None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:55.871141 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b173a-d2be-4922-8668-2f0ac9864037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:55.889911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7c4b173a-d2be-4922-8668-2f0ac9864037 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:55.891148 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7c4b173a-d2be-4922-8668-2f0ac9864037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:55.949027 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1428/2886] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:55.988768 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:55.990164 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:56.062492 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047419ac-18bc-4df5-82f1-3778e289af4a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:56.068128 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246593f-7390-4d83-8520-e6fb4fd50d50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:56.068733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246593f-7390-4d83-8520-e6fb4fd50d50 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:56.069014 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246593f-7390-4d83-8520-e6fb4fd50d50 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:56.069288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246593f-7390-4d83-8520-e6fb4fd50d50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:56.077407 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246593f-7390-4d83-8520-e6fb4fd50d50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:56.079366 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246593f-7390-4d83-8520-e6fb4fd50d50 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:56.088652 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1459/2887] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:59.343550 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7c3c-c796-4c3f-9ed9-3ec6cf87627f None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:59.344128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7c3c-c796-4c3f-9ed9-3ec6cf87627f None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:59.344128 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7c3c-c796-4c3f-9ed9-3ec6cf87627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:59.363994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-e88d7c3c-c796-4c3f-9ed9-3ec6cf87627f None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:59.365183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e88d7c3c-c796-4c3f-9ed9-3ec6cf87627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:59.372853 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1429/2888] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:59.393421 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246593f-7390-4d83-8520-e6fb4fd50d50 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:59.395065 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c246593f-7390-4d83-8520-e6fb4fd50d50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:59.410474 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246593f-7390-4d83-8520-e6fb4fd50d50 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:59.416443 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df7d62-a50c-4f30-b122-564904d3c4b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:59.417208 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df7d62-a50c-4f30-b122-564904d3c4b7 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:59.417496 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df7d62-a50c-4f30-b122-564904d3c4b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:59.417774 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df7d62-a50c-4f30-b122-564904d3c4b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:59.426564 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df7d62-a50c-4f30-b122-564904d3c4b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:59.428212 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df7d62-a50c-4f30-b122-564904d3c4b7 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:59.438339 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1460/2889] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:56:01.347756 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7c3c-c796-4c3f-9ed9-3ec6cf87627f None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:01.349143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-e88d7c3c-c796-4c3f-9ed9-3ec6cf87627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:01.360633 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7c3c-c796-4c3f-9ed9-3ec6cf87627f None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:01.365269 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:01.365880 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:01.366157 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:01.366460 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] PATH_INFO: `/v3/users/f02f6ad2eea64e03bc70e58af064dae6` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:01.367553 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f02f6ad2eea64e03bc70e58af064dae6)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:01.369439 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:01.506819 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f02f6ad2eea64e03bc70e58af064dae6'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:01.518968 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f02f6ad2eea64e03bc70e58af064dae6'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:01.595193 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f02f6ad2eea64e03bc70e58af064dae6'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:01.602753 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f02f6ad2eea64e03bc70e58af064dae6'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:01.603436 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f02f6ad2eea64e03bc70e58af064dae6'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:01.609393 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1430/2890] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:56:01 2022] DELETE /identity/v3/users/f02f6ad2eea64e03bc70e58af064dae6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:56:01.614558 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d95a7-881d-43cd-947c-4cf9db1576e3 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:01.615024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d95a7-881d-43cd-947c-4cf9db1576e3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:01.615125 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d95a7-881d-43cd-947c-4cf9db1576e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:01.635744 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-901d95a7-881d-43cd-947c-4cf9db1576e3 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:56:01.636948 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-901d95a7-881d-43cd-947c-4cf9db1576e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:01.695156 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1461/2891] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 22 12:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:56:01.704785 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:01.706183 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:01.762844 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b00cd-10cc-4626-b847-8bf6e6ae66d8 admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:01.766454 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0e38d-6c8f-43cb-b2a4-2a0f9aa326dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '948a5df1d4244c839a7faeb54f93dfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:01.767061 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0e38d-6c8f-43cb-b2a4-2a0f9aa326dc service neutron] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:01.767348 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0e38d-6c8f-43cb-b2a4-2a0f9aa326dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:01.767622 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0e38d-6c8f-43cb-b2a4-2a0f9aa326dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:01.776778 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0e38d-6c8f-43cb-b2a4-2a0f9aa326dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:01.778212 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0e38d-6c8f-43cb-b2a4-2a0f9aa326dc service neutron] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:01.788292 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1431/2892] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:56:02.231792 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d95a7-881d-43cd-947c-4cf9db1576e3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:02.233273 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-901d95a7-881d-43cd-947c-4cf9db1576e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:02.246825 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d95a7-881d-43cd-947c-4cf9db1576e3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:02.250772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:02.251520 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:02.251842 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:02.252148 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] PATH_INFO: `/v3/projects/bbd893b217f3416a80d4bc3fb9df24d0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:02.253277 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd893b217f3416a80d4bc3fb9df24d0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:02.255254 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:02.277253 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca44b-c970-4566-98e7-92274664bd7c None None] REQUEST_METHOD: `POST` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:02.277547 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca44b-c970-4566-98e7-92274664bd7c None None] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:02.277822 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca44b-c970-4566-98e7-92274664bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:02.297980 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.auth.core [None req-7b1ca44b-c970-4566-98e7-92274664bd7c None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:56:02.299196 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7b1ca44b-c970-4566-98e7-92274664bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:02.306911 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1432/2893] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:56:02.327682 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca44b-c970-4566-98e7-92274664bd7c None None] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:02.331143 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-7b1ca44b-c970-4566-98e7-92274664bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:02.334740 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:02.398641 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd893b217f3416a80d4bc3fb9df24d0', 'request_id': 'req-e247f6c1-2971-479a-8c8c-40b95e143020'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:02.408207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca44b-c970-4566-98e7-92274664bd7c None None] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:02.408804 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd893b217f3416a80d4bc3fb9df24d0', 'request_id': 'req-e247f6c1-2971-479a-8c8c-40b95e143020'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:02.475024 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4512cbf-0e62-4c1b-b467-43412bf43796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:02.475561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4512cbf-0e62-4c1b-b467-43412bf43796 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:02.475843 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4512cbf-0e62-4c1b-b467-43412bf43796 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:02.476119 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4512cbf-0e62-4c1b-b467-43412bf43796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:02.492234 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd893b217f3416a80d4bc3fb9df24d0', 'request_id': 'req-e247f6c1-2971-479a-8c8c-40b95e143020'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:02.497530 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:02.504306 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] The token cache is being invalidate because project bbd893b217f3416a80d4bc3fb9df24d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:56:02.504798 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:02.505464 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e247f6c1-2971-479a-8c8c-40b95e143020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:02.506990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1462/2894] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:56:02 2022] DELETE /identity/v3/projects/bbd893b217f3416a80d4bc3fb9df24d0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:56:02.543855 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4512cbf-0e62-4c1b-b467-43412bf43796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:02.545475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4512cbf-0e62-4c1b-b467-43412bf43796 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:02.556864 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1433/2895] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:56:05.585015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504965-c362-4917-8089-200e1d62f74e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:05.585698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504965-c362-4917-8089-200e1d62f74e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:05.585698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504965-c362-4917-8089-200e1d62f74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:05.605569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a4504965-c362-4917-8089-200e1d62f74e None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:56:05.606819 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a4504965-c362-4917-8089-200e1d62f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:05.614810 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1463/2896] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:56:05.639409 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4512cbf-0e62-4c1b-b467-43412bf43796 service nova] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:05.640735 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a4512cbf-0e62-4c1b-b467-43412bf43796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:05.655833 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4512cbf-0e62-4c1b-b467-43412bf43796 service nova] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:05.662497 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a824da-fff9-432f-ad09-e381203d8237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:05.668244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a824da-fff9-432f-ad09-e381203d8237 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:05.668244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a824da-fff9-432f-ad09-e381203d8237 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:05.668244 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a824da-fff9-432f-ad09-e381203d8237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:05.672369 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a824da-fff9-432f-ad09-e381203d8237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:05.674000 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a824da-fff9-432f-ad09-e381203d8237 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:05.683790 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1434/2897] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:56:08.786285 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8eb81-e90a-49eb-b610-5c2c0c03a035 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:08.786772 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8eb81-e90a-49eb-b610-5c2c0c03a035 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:08.786874 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8eb81-e90a-49eb-b610-5c2c0c03a035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:08.806179 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e0a8eb81-e90a-49eb-b610-5c2c0c03a035 None None] MFA Rules not processed for user `0beed70e660843e4af019f77be01b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:56:08.812990 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e0a8eb81-e90a-49eb-b610-5c2c0c03a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:08.815086 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1464/2898] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Aug 22 12:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:56:08.836977 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a824da-fff9-432f-ad09-e381203d8237 service nova] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:08.838387 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-c7a824da-fff9-432f-ad09-e381203d8237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:08.853916 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a824da-fff9-432f-ad09-e381203d8237 service nova] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:08.859339 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5623-750f-43a6-ae7b-52a7247af203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2f71ebeca2441791a0241de737cad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:08.859929 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5623-750f-43a6-ae7b-52a7247af203 service nova] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:08.860207 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5623-750f-43a6-ae7b-52a7247af203 service nova] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:08.860477 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5623-750f-43a6-ae7b-52a7247af203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:08.869771 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d5623-750f-43a6-ae7b-52a7247af203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:08.872382 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d5623-750f-43a6-ae7b-52a7247af203 service nova] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:08.880999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1435/2899] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 12:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:56:18.800538 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=8 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:18.876528 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=97 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:40.496661 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ec8fa-9e56-418a-a3de-09ce635186ee None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:40.497160 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ec8fa-9e56-418a-a3de-09ce635186ee None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:40.497265 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ec8fa-9e56-418a-a3de-09ce635186ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:40.525873 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-480ec8fa-9e56-418a-a3de-09ce635186ee None None] MFA Rules not processed for user `be2fc683522941169708877bcfe2dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:56:40.527085 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-480ec8fa-9e56-418a-a3de-09ce635186ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:40.580456 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1465/2900] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 22 12:56:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:56:40.624006 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5623-750f-43a6-ae7b-52a7247af203 service nova] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:40.625425 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-f37d5623-750f-43a6-ae7b-52a7247af203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:40.696561 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5623-750f-43a6-ae7b-52a7247af203 service nova] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:40.701475 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d9d43-7986-4e94-8a0d-fd47382cdac3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656ce4b09cf6425193b7e58562ccaced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:40.702109 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d9d43-7986-4e94-8a0d-fd47382cdac3 service swift] REQUEST_METHOD: `GET` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:40.702421 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d9d43-7986-4e94-8a0d-fd47382cdac3 service swift] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:40.702697 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d9d43-7986-4e94-8a0d-fd47382cdac3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:40.711442 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d9d43-7986-4e94-8a0d-fd47382cdac3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:40.713009 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d9d43-7986-4e94-8a0d-fd47382cdac3 service swift] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:40.721216 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1436/2901] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 22 12:56:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:56:41.992210 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ec8fa-9e56-418a-a3de-09ce635186ee None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:41.995263 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-480ec8fa-9e56-418a-a3de-09ce635186ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:42.013726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ec8fa-9e56-418a-a3de-09ce635186ee None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:42.018313 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:42.019024 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:42.019311 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:42.019596 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] PATH_INFO: `/v3/users/c1567c2e8dd3472690387fae64d3ae54` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:42.020735 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1567c2e8dd3472690387fae64d3ae54)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:42.023288 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:42.221526 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1567c2e8dd3472690387fae64d3ae54'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:42.222176 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1567c2e8dd3472690387fae64d3ae54'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:42.229512 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1567c2e8dd3472690387fae64d3ae54'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:42.241895 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1567c2e8dd3472690387fae64d3ae54'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:42.332196 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1567c2e8dd3472690387fae64d3ae54'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:42.339822 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1466/2902] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:56:41 2022] DELETE /identity/v3/users/c1567c2e8dd3472690387fae64d3ae54 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:56:42.638571 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d9d43-7986-4e94-8a0d-fd47382cdac3 service swift] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:42.653736 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d9d43-7986-4e94-8a0d-fd47382cdac3 service swift] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:42.730907 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:42.731754 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:42.732114 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:42.732463 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] PATH_INFO: `/v3/projects/e27eb550e8344233af0ec1fd741d9852` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:42.734130 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27eb550e8344233af0ec1fd741d9852)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:42.735985 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:42.876686 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27eb550e8344233af0ec1fd741d9852', 'request_id': 'req-a76de09c-7719-4008-832d-ecd14730ae4c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:42.955075 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27eb550e8344233af0ec1fd741d9852', 'request_id': 'req-a76de09c-7719-4008-832d-ecd14730ae4c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:42.961719 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27eb550e8344233af0ec1fd741d9852', 'request_id': 'req-a76de09c-7719-4008-832d-ecd14730ae4c'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:42.973757 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] The token cache is being invalidate because project e27eb550e8344233af0ec1fd741d9852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:56:42.974047 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:42.975469 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:42.976959 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1437/2903] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:56:42 2022] DELETE /identity/v3/projects/e27eb550e8344233af0ec1fd741d9852 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:56:48.790393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:48.791867 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:48.806961 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111d729-4f11-48d4-9cb5-a7ce83f4e584 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:48.862787 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:48.863361 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:48.863644 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:48.863922 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] PATH_INFO: `/v3/users/098e78dc604b4f5ab1e92a21baa4f3fc` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:48.865748 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=098e78dc604b4f5ab1e92a21baa4f3fc)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:48.867712 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:48.878429 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:49.077498 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098e78dc604b4f5ab1e92a21baa4f3fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.078153 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098e78dc604b4f5ab1e92a21baa4f3fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.085470 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098e78dc604b4f5ab1e92a21baa4f3fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.097929 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098e78dc604b4f5ab1e92a21baa4f3fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.195344 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098e78dc604b4f5ab1e92a21baa4f3fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.201726 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1467/2904] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:56:48 2022] DELETE /identity/v3/users/098e78dc604b4f5ab1e92a21baa4f3fc => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:56:49.447774 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:49.451341 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:49.462592 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76de09c-7719-4008-832d-ecd14730ae4c admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:49.480787 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:49.520363 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:49.521639 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:49.521935 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:49.522294 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] PATH_INFO: `/v3/projects/a532a86ae0674f26b2795a53c55b53ee` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:49.523480 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a532a86ae0674f26b2795a53c55b53ee)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:49.525500 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:49.651999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a532a86ae0674f26b2795a53c55b53ee', 'request_id': 'req-098b33bc-eb98-4c30-a0ed-edee493b519a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.725934 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a532a86ae0674f26b2795a53c55b53ee', 'request_id': 'req-098b33bc-eb98-4c30-a0ed-edee493b519a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.731708 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a532a86ae0674f26b2795a53c55b53ee', 'request_id': 'req-098b33bc-eb98-4c30-a0ed-edee493b519a'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.742994 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] The token cache is being invalidate because project a532a86ae0674f26b2795a53c55b53ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:56:49.743283 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.743999 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.745384 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1438/2905] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:56:49 2022] DELETE /identity/v3/projects/a532a86ae0674f26b2795a53c55b53ee => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:56:49.749410 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:49.751400 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:49.765569 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e4928-f977-42b9-8994-f265763b4f37 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:49.822393 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:49.823015 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:49.823282 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:49.823555 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] PATH_INFO: `/v3/users/a829d76ee1f94e9abd0fb3cebf7280fc` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:49.824698 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a829d76ee1f94e9abd0fb3cebf7280fc)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:49.826674 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:49.990472 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a829d76ee1f94e9abd0fb3cebf7280fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.991123 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a829d76ee1f94e9abd0fb3cebf7280fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:49.998103 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a829d76ee1f94e9abd0fb3cebf7280fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:50.010797 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a829d76ee1f94e9abd0fb3cebf7280fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:50.051500 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a829d76ee1f94e9abd0fb3cebf7280fc'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:50.058651 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1468/2906] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 22 12:56:49 2022] DELETE /identity/v3/users/a829d76ee1f94e9abd0fb3cebf7280fc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:56:50.299507 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] Authenticating user token {{(pid=81822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:50.301030 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.fernet_utils [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:50.317766 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b33bc-eb98-4c30-a0ed-edee493b519a admin admin] Validating token access rules against request {{(pid=81822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:50.375231 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0beed70e660843e4af019f77be01b3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6699bdfe1f6a452e99cfdff2e04fc5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:50.375861 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:50.376144 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:50.376420 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] PATH_INFO: `/v3/projects/a34c4a92b7e840d7b80d34cd56815666` {{(pid=81822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:50.377524 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34c4a92b7e840d7b80d34cd56815666)` {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:50.379755 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] RBAC: Authorization granted {{(pid=81822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:50.487747 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34c4a92b7e840d7b80d34cd56815666', 'request_id': 'req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:50.490364 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:50.618015 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34c4a92b7e840d7b80d34cd56815666', 'request_id': 'req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:50.623909 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34c4a92b7e840d7b80d34cd56815666', 'request_id': 'req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50'} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:50.635164 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] The token cache is being invalidate because project a34c4a92b7e840d7b80d34cd56815666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:56:50.635452 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:50.636090 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG keystone.notifications [None req-7156a34b-cfc1-47ea-b2ea-76425bbf0b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:56:50.637566 dv-cinder-850836-6-smb devstack@keystone.service[81822]: [pid: 81822|app: 0|req: 1439/2907] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 22 12:56:50 2022] DELETE /identity/v3/projects/a34c4a92b7e840d7b80d34cd56815666 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:57:00.054578 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=20,keystone:SELECT=75,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:00.749110 dv-cinder-850836-6-smb devstack@keystone.service[81822]: DEBUG dbcounter [-] [81822] Writing DB stats keystone:DELETE=3,keystone:SELECT=6 {{(pid=81822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:01:21.699267 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:01:21.700700 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:01:21.770409 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671b0ab-000c-4b00-838d-643228f1ccc4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:01:21.828833 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1bcea-70a1-4c6f-860c-5e09ef6c82de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa8495c97df48f18b10039584d52f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dcfbd4f4437418db2cacabef3850ffe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:01:21.829444 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1bcea-70a1-4c6f-860c-5e09ef6c82de service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:01:21.829727 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1bcea-70a1-4c6f-860c-5e09ef6c82de service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:01:21.830003 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1bcea-70a1-4c6f-860c-5e09ef6c82de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:01:21.831736 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-afe1bcea-70a1-4c6f-860c-5e09ef6c82de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:01:21.843157 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1bcea-70a1-4c6f-860c-5e09ef6c82de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:01:21.844733 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1bcea-70a1-4c6f-860c-5e09ef6c82de service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:01:21.854677 dv-cinder-850836-6-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1469/2908] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 22 13:01:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 13:01:31.850549 dv-cinder-850836-6-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=58 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}